Error on startup 1.5 #4360

ymabispo · 2018-07-04T11:11:44Z

Gitea version (or commit ref): 1.5
Git version: 2.17.1
Operating system: Windows Server 2008 R2 Standard
Database (use [x]):
- PostgreSQL
- MySQL
- MSSQL
- SQLite
Can you reproduce the bug at https://try.gitea.io:
- Yes (provide example URL)
- No
- Not relevant
Log gist:

Description

Guys, a few minutes ago a tried to update 1.4.3 to 1.5 and the windows service doesn't start up.
log error:

2018/07/04 07:56:23 [I] Log Mode: File(Trace)
2018/07/04 07:56:23 [I] XORM Log Mode: File(Trace)
2018/07/04 07:56:23 [I] Cache Service Enabled
2018/07/04 07:56:23 [I] Session Service Enabled
2018/07/04 07:56:23 [I] Migration: add multiple assignees
2018/07/04 07:56:23 [...itea/routers/init.go:60 GlobalInit()] [E] Failed to initialize ORM engine: migrate: do migrate: Drop table issue columns [assignee_id]: mssql: ALTER TABLE DROP COLUMN assignee_id failed because one or more objects access this column.
...

Screenshots

The text was updated successfully, but these errors were encountered:

lunny · 2018-07-04T13:30:15Z

The CI for MSSQL could be added by #4282

lafriks · 2018-07-13T05:44:03Z

@ymabispo can you check if code from pull request #4440 fixes your problem?

bjoe2k4 · 2018-07-14T17:21:42Z

@lafriks I'm seeing a similar problem after updating from 1.4.1 to git-master, but with mysql.

[I] Gitea v8e103d3 built with: bindata, sqlite
[...itea/routers/init.go:60 GlobalInit()] [E] Failed to initialize ORM engine: migrate: do migrate: Drop table `issue` columns [assignee_id]: sql: Transaction has already been committed or rolled back```

back2root · 2018-07-17T21:49:06Z

@lafriks I guess commit e95417e fixes an issue for MSSQL but introduces an issue for MySQL.

I do see a similar problem as @bjoe2k4 but with migrating db v69 -> 70 as it seems that I'm already on a newer DB Version.

Error Message I get on first Start:

2018/07/17 20:29:18 [I] Migration: move team units to team_unit table
2018/07/17 20:29:19 [...itea/routers/init.go:60 GlobalInit()] [E] Failed to initialize ORM engine: migrate: do migrate: Drop table team columns [unit_types]: sql: Transaction has already been committed or rolled back

Subsequent Starts will log (just in case anyone is googling for this error):

2018/07/17 20:37:42 [I] Migration: move team units to team_unit table
2018/07/17 20:37:42 [...itea/routers/init.go:60 GlobalInit()] [E] Failed to initialize ORM engine: migrate: do migrate: Insert team units: Error 1062: Duplicate entry '1-1' for key 'UQE_team_unit_s'

My first guess is that we simply need to open a new session:

Insert (after committing session):

sess.Close()
sess := x.NewSession()
defer sess.Close()

back2root · 2018-07-17T22:25:25Z

If PR #4459 get's accepted and you still get the following error:

2018/07/17 20:37:42 [I] Migration: move team units to team_unit table
2018/07/17 20:37:42 [...itea/routers/init.go:60 GlobalInit()] [E] Failed to initialize ORM engine: migrate: do migrate: Insert team units: Error 1062: Duplicate entry '1-1' for key 'UQE_team_unit_s'

you may simply "drop table team_unit" and restart gitea.

johanhugg · 2018-07-19T14:54:52Z

Getting this too..
2018/07/19 14:48:17 [...itea/routers/init.go:60 GlobalInit()] [E] Failed to initialize ORM engine: migrate: do migrate: Drop table issue columns [assignee_id]: sql: Transaction has already been committed or rolled back

However, we're using postgres

johanhugg · 2018-07-19T15:10:47Z

I manually applied PR #4459 and it worked wonderfully!

lunny · 2018-07-20T02:26:55Z

@johanhugg could you try #4473 if it works?

anthrogan · 2018-08-13T06:45:48Z

I attempted updating today from 1.4.1 and had the same issue #4473 doesn't seem to fix it (Running on windows 10 pro box)

aurel-appsthru · 2018-08-20T15:53:18Z

Hi , I attempted updating today from 1.4.3 to 1.5 and had the same issue #4360

2018/08/20 17:28:46 [...itea/routers/init.go:60 GlobalInit()] [E] Failed to initialize ORM engine: migrate: do migrate: Drop table issue columns [assignee_id]: mssql: ALTER TABLE DROP COLUMN assignee_id a échoué car un ou plusieurs objets accèdent à cette colonne.

( Windows Server 2008R2 , MSSQL 2012 )

thx for your help

lafriks · 2018-08-21T10:26:52Z

Were you using final 1.5.0 release?

bjoe2k4 · 2018-08-21T11:17:45Z

I have just updated from 1.4.1 to 1.5.0. Worked fine for me. So the error I received earlier (same as the one of @aurel-appsthru) seems to be resolved for me.

Edit: However there are a bunch of logs emitted on every restart, How to get rid of them?

gitea-1.5.0-linux-amd64[12494]: 2018/08/21 13:18:03 [W] Table user Column allow_create_organization db default is 1, struct default is true
gitea-1.5.0-linux-amd64[12494]: 2018/08/21 13:18:03 [W] Table user Column prohibit_login db default is 0, struct default is false
gitea-1.5.0-linux-amd64[12494]: 2018/08/21 13:18:03 [W] Table repository Column is_fork db default is 0, struct default is false
gitea-1.5.0-linux-amd64[12494]: 2018/08/21 13:18:03 [W] Table repository Column is_fsck_enabled db default is 1, struct default is true
gitea-1.5.0-linux-amd64[12494]: 2018/08/21 13:18:03 [W] Table action Column is_deleted db default is 0, struct default is false
gitea-1.5.0-linux-amd64[12494]: 2018/08/21 13:18:03 [W] Table action Column is_private db default is 0, struct default is false
gitea-1.5.0-linux-amd64[12494]: 2018/08/21 13:18:03 [W] Table mirror Column enable_prune db default is 1, struct default is true
gitea-1.5.0-linux-amd64[12494]: 2018/08/21 13:18:03 [W] Table release Column is_draft db default is 0, struct default is false
gitea-1.5.0-linux-amd64[12494]: 2018/08/21 13:18:03 [W] Table release Column is_prerelease db default is 0, struct default is false
gitea-1.5.0-linux-amd64[12494]: 2018/08/21 13:18:03 [W] Table release Column is_tag db default is 0, struct default is false
gitea-1.5.0-linux-amd64[12494]: 2018/08/21 13:18:03 [W] Table login_source Column is_actived db default is 0, struct default is false
gitea-1.5.0-linux-amd64[12494]: 2018/08/21 13:18:03 [W] Table login_source Column is_sync_enabled db default is 0, struct default is false
gitea-1.5.0-linux-amd64[12494]: 2018/08/21 13:18:03 [W] Table protected_branch Column can_push db default is 0, struct default is false
gitea-1.5.0-linux-amd64[12494]: 2018/08/21 13:18:03 [W] Table protected_branch Column enable_merge_whitelist db default is 0, struct default is false
gitea-1.5.0-linux-amd64[12494]: 2018/08/21 13:18:03 [W] Table user_open_id Column show db default is 0, struct default is false
gitea-1.5.0-linux-amd64[12494]: 2018/08/21 13:18:03 [W] Table comment has column old_assignee_id but struct has not related field

aurel-appsthru · 2018-08-21T12:15:48Z

@lafriks : yes I tried with 1.5.0. The service start but stop on first refresh of a page.
I tried also 1.5 and master : service did not start, same log.

( Windows Server 2008R2 , MSSQL 2012 )

1.5.0 log :

2018/08/21 14:04:40 [I] Log Mode: File(Trace)
2018/08/21 14:04:40 [I] XORM Log Mode: File(Trace)
2018/08/21 14:04:40 [I] Cache Service Enabled
2018/08/21 14:04:40 [I] Session Service Enabled
2018/08/21 14:04:40 [I] Migration: add label descriptions
2018/08/21 14:04:42 [I] Migration: add merge whitelist for protected branches
2018/08/21 14:04:43 [I] Migration: add is_fsck_enabled column for repos
2018/08/21 14:04:45 [I] Migration: add size column for attachments
2018/08/21 14:04:45 [...ations/migrations.go:53 Migrate()] [E] calculate file size of attachment[UUID: 8162838b-76b5-410f-a546-3be9ae7d995e]: CreateFile E:\GitRepositories\attachments/8/1/8162838b-76b5-410f-a546-3be9ae7d995e: Le chemin d’accès spécifié est introuvable.
2018/08/21 14:04:45 [I] Migration: add last used passcode column for TOTP
2018/08/21 14:04:45 [I] Migration: add language column for user setting
2018/08/21 14:04:45 [I] Migration: add multiple assignees
2018/08/21 14:04:45 [...itea/routers/init.go:60 GlobalInit()] [E] Failed to initialize ORM engine: migrate: do migrate: Drop table issue columns [assignee_id]: mssql: ALTER TABLE DROP COLUMN assignee_id a échoué car un ou plusieurs objets accèdent à cette colonne.

1.5 and master log :

2018/08/21 14:07:52 [I] Log Mode: File(Trace)
2018/08/21 14:07:52 [I] XORM Log Mode: File(Trace)
2018/08/21 14:07:52 [I] Cache Service Enabled
2018/08/21 14:07:52 [I] Session Service Enabled
2018/08/21 14:07:52 [I] Migration: add multiple assignees
2018/08/21 14:07:52 [...itea/routers/init.go:60 GlobalInit()] [E] Failed to initialize ORM engine: migrate: do migrate: Drop table issue columns [assignee_id]: mssql: ALTER TABLE DROP COLUMN assignee_id a échoué car un ou plusieurs objets accèdent à cette colonne.

tenacubus · 2018-08-28T14:38:05Z

@lafriks I'm still getting the migration issue with the new 1.5.0 binary as well

2018/08/28 09:43:25 [I] Migration: add multiple assignees
2018/08/28 09:43:25 [...itea/routers/init.go:60 GlobalInit()] [E] Failed to initialize ORM engine: migrate: do migrate: Drop table issue columns [assignee_id]: mssql: ALTER TABLE DROP COLUMN assignee_id failed because one or more objects access this column.

Tried running the alter drop column manually in mssql to see if I got a more descriptive error. Turns out we've got an index IDX_issue_assignee_id hanging around getting in the way.

Msg 5074, Level 16, State 1, Line 7
The index 'IDX_issue_assignee_id' is dependent on column 'assignee_id'.
Msg 4922, Level 16, State 9, Line 7
ALTER TABLE DROP COLUMN assignee_id failed because one or more objects access this column.

Manually deleting the index and rerunning the upgrade finished successfully

aurel-appsthru · 2018-08-31T11:24:21Z

@lafriks @tenacubus
Hi, deleting the index manually, it works.

DROP INDEX [IDX_issue_assignee_id] ON [dbo].[issue]

thx a lot

leepfrog-ger · 2018-09-05T12:55:00Z

@lafriks I received the same error as @aurel-appsthru and @tenacubus
when updating from 1.4.1 to 1.5.1 running on MSSQL 2016.

Dropping the index DROP INDEX [IDX_issue_assignee_id] ON [dbo].[issue] allowed the migration to run through

Maybe this should be treated as separate issue as this original error in this issue seems to be different

tenacubus · 2018-09-05T16:11:10Z

@leepfrog-ger I'd say we should reopen this issue as the initial error was the exact one I had. Additionally the initial poster never confirmed it fixed their problem. Hey @ymabispo did you ever try it?

What do you think @lafriks? I don't know the policy as far as reopening issues or creating a new one.

I see the mssql code in DropTableColumns only looks for and deletes constraints but does not address indexes

gitea/models/migrations/migrations.go

Lines 269 to 298 in 6e64f9d

    
           case setting.UseMSSQL: 
        
           	cols := "" 
        
           	for _, col := range columnNames { 
        
           		if cols != "" { 
        
           			cols += ", " 
        
           		} 
        
           		cols += "`" + strings.ToLower(col) + "`" 
        
           	} 
        
           	sql := fmt.Sprintf("SELECT Name FROM SYS.DEFAULT_CONSTRAINTS WHERE PARENT_OBJECT_ID = OBJECT_ID('%[1]s') AND PARENT_COLUMN_ID IN (SELECT column_id FROM sys.columns WHERE lower(NAME) IN (%[2]s) AND object_id = OBJECT_ID('%[1]s'))", 
        
           		tableName, strings.Replace(cols, "`", "'", -1)) 
        
           	constraints := make([]string, 0) 
        
           	if err := sess.SQL(sql).Find(&constraints); err != nil { 
        
           		sess.Rollback() 
        
           		return fmt.Errorf("Find constraints: %v", err) 
        
           	} 
        
           	for _, constraint := range constraints { 
        
           		if _, err := sess.Exec(fmt.Sprintf("ALTER TABLE `%s` DROP CONSTRAINT `%s`", tableName, constraint)); err != nil { 
        
           			sess.Rollback() 
        
           			return fmt.Errorf("Drop table `%s` constraint `%s`: %v", tableName, constraint, err) 
        
           		} 
        
           	} 
        
           	if _, err := sess.Exec(fmt.Sprintf("ALTER TABLE `%s` DROP COLUMN %s", tableName, cols)); err != nil { 
        
           		sess.Rollback() 
        
           		return fmt.Errorf("Drop table `%s` columns %v: %v", tableName, columnNames, err) 
        
           	} 
        
           	return sess.Commit() 
        
           default: 
        
           	log.Fatal(4, "Unrecognized DB") 
        
           }

leepfrog-ger · 2018-09-07T10:29:14Z

@tenacubus you are right, I mixed up something, I've also got the same errors as in the initial issue. so the reopening is fine with me.

ymabispo · 2018-09-07T16:21:38Z

Hi guys, sorry about the late response.
I've been using gitea to manage very important repositories, so i can not try a new update without any confirmation about the integrity of this new version.

Thanks

davydov-vyacheslav · 2018-09-26T08:34:17Z

is there any update on 1.5.2 issues? E.g. this issue looks like critical and I'm scaring of upgrading to latest 1.5 version (from 1.4)

Thanks in advance

lafriks · 2018-09-26T22:48:26Z

@davydov-vyacheslav it only affects instamces running mssql database

davydov-vyacheslav · 2018-09-27T07:33:11Z

ok. thank you

vinnyaju · 2018-11-28T14:02:16Z

I'm on version 1.4.3 and i tried to delete manually using DROP INDEX [IDX_issue_assignee_id] ON [dbo].[issue]
and now i'm stuck in a timeout while applying another migration "[I] Migration: remove stale watches"

i've tried to migrate from 1.4.3 to 1.5, 1.5.1, 1.5.3 and 1.6 allways restoring the database and runing all the way through.

lafriks · 2018-12-27T10:52:31Z

I think there was some mssql fixes for migrations. Is this still an unresolved issue?

vinnyaju · 2018-12-27T17:14:38Z

i just tried update from 1.4.3 to 1.6.2 and i got:

2018/12/27 14:02:34 [...itea/routers/init.go:60 GlobalInit()] [E] Failed to initialize ORM engine: migrate: do migrate: Drop table issue columns [assignee_id]: mssql: ALTER TABLE DROP COLUMN assignee_id failed because one or more objects access this column.

and i droped the index on issue table:
DROP INDEX [IDX_issue_assignee_id] ON [dbo].[issue]

then i got more migrations applied:
2018/12/27 14:06:38 [I] Migration: add multiple assignees
2018/12/27 14:06:38 [I] Migration: add u2f
2018/12/27 14:06:39 [I] Migration: add login source id column for public_key table

and got a timeout...
2018/12/27 14:06:42 [I] Migration: remove stale watches
2018/12/27 14:07:13 [...itea/routers/init.go:60 GlobalInit()] [E] Failed to initialize ORM engine: migrate: do migrate: read tcp 10.100.4.98:57151->10.200.5.108:1433: i/o timeout

Still can't evolve my version...

rafaeldeda · 2019-01-21T12:40:31Z

Guys, anyone to help us? We are still having trouble updating gitea version 1.4.3 to version 1.7 motivated by this error in mssql. Will there be any correction for this?

vinnyaju · 2019-02-12T13:25:45Z

As i said in my last comment here, after i dropped the index on issue table i got a timeout.

Watching a more detailed log i saw the timeout in this statement: SELECT * FROM "watch" WHERE (id NOT IN (SELECT TOP 50 id FROM "watch"))

So i decided to delete all the data in the watch table and tried to update from 1.4.3 to 1.7.1 and it was ok in my test environment, i'll do it in production environment tomorrow morning and send an e-mail telling everyone to click watch button in the repository they want to follow.

The problem with the update has something to do with the data that was in this table...

lunny · 2019-12-14T01:32:18Z

Some migrations depends on how many rows of that table. It may timeout on some situations.

stale · 2020-02-20T06:44:21Z

This issue has been automatically marked as stale because it has not had recent activity. I am here to help clear issues left open even if solved or waiting for more insight. This issue will be closed if no further activity occurs during the next 2 weeks. If the issue is still valid just add a comment to keep it alive. Thank you for your contributions.

stale · 2020-03-05T07:37:53Z

This issue has been automatically closed because of inactivity. You can re-open it if needed.

lunny added the type/bug label Jul 4, 2018

daviian modified the milestone: 1.5.0 Jul 4, 2018

daviian added the issue/critical This issue should be fixed ASAP. If it is a PR, the PR should be merged ASAP label Jul 4, 2018

This was referenced Jul 11, 2018

Switch plaintext scratch tokens to use hash instead #4331

Merged

Fix column droping for MSSQL that need new transaction for that #4440

Merged

techknowlogick closed this as completed in #4440 Jul 13, 2018

lafriks reopened this Jul 14, 2018

back2root mentioned this issue Jul 17, 2018

Fix column droping for MySQL that need a new session for the new transaction #4459

Closed

lafriks mentioned this issue Jul 19, 2018

Update xorm to latest version and fix correct user table referencing in sql #4473

Merged

lunny closed this as completed in #4473 Jul 20, 2018

lafriks reopened this Sep 5, 2018

techknowlogick modified the milestones: 1.5.2, 1.7.0 Oct 9, 2018

lafriks modified the milestones: 1.7.0, 1.8.0 Dec 27, 2018

lafriks added the issue/needs-feedback For bugs, we need more details. For features, the feature must be described in more detail label Dec 27, 2018

lunny mentioned this issue Jan 21, 2019

Error migrating from version 1.4.3 to version 1.7 #5792

Closed

7 tasks

techknowlogick modified the milestones: 1.8.0, 1.9.0 Feb 19, 2019

techknowlogick modified the milestones: 1.9.0, 1.10.0 Jun 4, 2019

techknowlogick modified the milestones: 1.10.0, 1.11.0 Sep 3, 2019

techknowlogick removed the issue/critical This issue should be fixed ASAP. If it is a PR, the PR should be merged ASAP label Dec 22, 2019

techknowlogick removed this from the 1.11.0 milestone Dec 22, 2019

stale bot added the issue/stale label Feb 20, 2020

stale bot closed this as completed Mar 5, 2020

go-gitea locked and limited conversation to collaborators Nov 24, 2020

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Error on startup 1.5 #4360

Error on startup 1.5 #4360

ymabispo commented Jul 4, 2018

lunny commented Jul 4, 2018

lafriks commented Jul 13, 2018

bjoe2k4 commented Jul 14, 2018

back2root commented Jul 17, 2018

back2root commented Jul 17, 2018

johanhugg commented Jul 19, 2018 •

edited

Loading

johanhugg commented Jul 19, 2018

lunny commented Jul 20, 2018

anthrogan commented Aug 13, 2018

aurel-appsthru commented Aug 20, 2018

lafriks commented Aug 21, 2018

bjoe2k4 commented Aug 21, 2018 •

edited

Loading

aurel-appsthru commented Aug 21, 2018

tenacubus commented Aug 28, 2018 •

edited

Loading

aurel-appsthru commented Aug 31, 2018

leepfrog-ger commented Sep 5, 2018

tenacubus commented Sep 5, 2018

leepfrog-ger commented Sep 7, 2018

ymabispo commented Sep 7, 2018

davydov-vyacheslav commented Sep 26, 2018

lafriks commented Sep 26, 2018

davydov-vyacheslav commented Sep 27, 2018

vinnyaju commented Nov 28, 2018

lafriks commented Dec 27, 2018

vinnyaju commented Dec 27, 2018 •

edited

Loading

rafaeldeda commented Jan 21, 2019

vinnyaju commented Feb 12, 2019

lunny commented Dec 14, 2019

stale bot commented Feb 20, 2020

stale bot commented Mar 5, 2020

Error on startup 1.5 #4360

Error on startup 1.5 #4360

Comments

ymabispo commented Jul 4, 2018

Description

Screenshots

lunny commented Jul 4, 2018

lafriks commented Jul 13, 2018

bjoe2k4 commented Jul 14, 2018

back2root commented Jul 17, 2018

back2root commented Jul 17, 2018

johanhugg commented Jul 19, 2018 • edited Loading

johanhugg commented Jul 19, 2018

lunny commented Jul 20, 2018

anthrogan commented Aug 13, 2018

aurel-appsthru commented Aug 20, 2018

lafriks commented Aug 21, 2018

bjoe2k4 commented Aug 21, 2018 • edited Loading

aurel-appsthru commented Aug 21, 2018

tenacubus commented Aug 28, 2018 • edited Loading

aurel-appsthru commented Aug 31, 2018

leepfrog-ger commented Sep 5, 2018

tenacubus commented Sep 5, 2018

leepfrog-ger commented Sep 7, 2018

ymabispo commented Sep 7, 2018

davydov-vyacheslav commented Sep 26, 2018

lafriks commented Sep 26, 2018

davydov-vyacheslav commented Sep 27, 2018

vinnyaju commented Nov 28, 2018

lafriks commented Dec 27, 2018

vinnyaju commented Dec 27, 2018 • edited Loading

rafaeldeda commented Jan 21, 2019

vinnyaju commented Feb 12, 2019

lunny commented Dec 14, 2019

stale bot commented Feb 20, 2020

stale bot commented Mar 5, 2020

johanhugg commented Jul 19, 2018 •

edited

Loading

bjoe2k4 commented Aug 21, 2018 •

edited

Loading

tenacubus commented Aug 28, 2018 •

edited

Loading

vinnyaju commented Dec 27, 2018 •

edited

Loading