Cross compiling fails #384

samhh · 2017-02-21T17:16:46Z

Very possibly a mistake on my part, if so please let me know where I went wrong. My first time with Go today!

I have a basic Go file using this library. I am on macOS 10.12.3, Go 1.8 darwin/amd64.

Succeeds: env GOOS=darwin go build -i app.go

Fails: env GOOS=linux go build -i app.go

Specifying GOARCH=amd64 makes no difference.

Errors:

../../../go/src/github.com/mattn/go-sqlite3/sqlite3_go18.go:18: undefined: SQLiteConn
../../../go/src/github.com/mattn/go-sqlite3/sqlite3_go18.go:26: undefined: SQLiteConn
../../../go/src/github.com/mattn/go-sqlite3/sqlite3_go18.go:27: undefined: namedValue
../../../go/src/github.com/mattn/go-sqlite3/sqlite3_go18.go:29: undefined: namedValue
../../../go/src/github.com/mattn/go-sqlite3/sqlite3_go18.go:35: undefined: SQLiteConn
../../../go/src/github.com/mattn/go-sqlite3/sqlite3_go18.go:36: undefined: namedValue
../../../go/src/github.com/mattn/go-sqlite3/sqlite3_go18.go:44: undefined: SQLiteConn
../../../go/src/github.com/mattn/go-sqlite3/sqlite3_go18.go:49: undefined: SQLiteConn
../../../go/src/github.com/mattn/go-sqlite3/sqlite3_go18.go:54: undefined: SQLiteStmt
../../../go/src/github.com/mattn/go-sqlite3/sqlite3_go18.go:63: undefined: SQLiteStmt
../../../go/src/github.com/mattn/go-sqlite3/sqlite3_go18.go:36: too many errors

Said very basic Go file causing this, in-case it helps:

package main

import (
	"database/sql"
	"log"
	"os"
	_ "github.com/mattn/go-sqlite3"
)

// Bookmark represents a single row from database
type Bookmark struct {
	Id       int
	Url      string
	Metadata string
	Tags     string
	Desc     string
	Flags    int
}

func main() {
	dbpath := GetDbPath()

	db := InitDB(dbpath)
	defer db.Close()

	bookmarks := GetAllBookmarks(db)
	log.Print(bookmarks)
}

// Write errors to log & quit
func CheckError(err error) {
	if err != nil {
		log.Fatal(err)
	}
}

func InitDB(filepath string) *sql.DB {
	db, err := sql.Open("sqlite3", filepath)
	CheckError(err)
	if db == nil {
		panic("db nil")
	}
	return db
}

func GetAllBookmarks(db *sql.DB) []Bookmark {
	const queryAll string = "SELECT * FROM bookmarks;"

	rows, err := db.Query(queryAll)
	CheckError(err)
	defer rows.Close()

	var result []Bookmark
	for rows.Next() {
		item := Bookmark{}
		err2 := rows.Scan(&item.Id, &item.Url, &item.Metadata, &item.Tags, &item.Desc, &item.Flags)
		CheckError(err2)
		result = append(result, item)
	}

	return result
}

func GetDbPath() string {
	const dbFileName string = "bookmarks.db"

	var dir = os.Getenv("XDG_DATA_HOME")
	if dir != "" {
		dir += "/buku/"
	} else {
		dir = os.Getenv("HOME") + "/.local/share/buku/"
	}

	dir += dbFileName

	return dir
}

The text was updated successfully, but these errors were encountered:

mattn · 2017-02-21T17:24:11Z

Maybe you don't install/set cross C compiler for Linux.

samhh · 2017-02-21T17:34:20Z

Is that gcc? If so I just installed version 6 of that, but the same problem remains.

mattn · 2017-02-21T17:36:38Z

Not host compiler. I mean cross compiler. Install cross C compiler, then set $CC.

samhh · 2017-02-21T17:50:29Z

So I've installed this: https://github.com/crosstool-ng/crosstool-ng

No luck.

So I tried setting env $CC to ct-ng first, still no luck.

Unsure where to go from here.

Sorry to be a pest! 🙏

mattn · 2017-02-21T18:16:50Z

Unfortunately, I don't have OSX. So that's all I can tell you. Sorry

samhh · 2017-02-22T14:02:23Z

Well, the good news is that I can build Linux just fine if I boot an Arch VM and do it from there.

Still no idea how to get it working from within macOS, so if anyone wants to chime in that'd be appreciated. :-)

vorlif · 2017-02-22T17:58:15Z

Hi Mattn,

I have the same problem with go 1.8.
If I downgrade to 1.7 there are no more problems. So I do not think there is a problem with the compiler.

OS: Linux x86_64

mattn · 2017-02-23T00:42:06Z

Maybe your CGO_ENABLED is 0

vorlif · 2017-02-23T09:09:02Z

With go 1.7 I can cross compile without a C cross compiler (like mingw). I can use the native go compiler and have no problems.

# This works, but only with go 1.7
# Not with go 1.8
env CGO_ENABLED=0 GOOS=windows GOARCH=amd64 go build

If I understood it right CGO_ENABLED=1 requires a C cross compiler?

Is enabled cgo a new dependency if I want to use your package with go 1.8?

Thanks for your work and your time!

mattn · 2017-02-23T12:55:51Z

Maybe, the driver built on go1.7 does not work. It should be empty module.

Lindenk · 2017-03-01T15:52:50Z

I'm now having the same problem when trying to compile specifically this for ARM. It was working fine with go 1.7 for me as well.

rusenask · 2017-03-01T20:41:26Z

Noticed this as well, trying to create some workaround.. I am a bit sceptical that this is related to Go 1.8 as I have been using it since December and it was compiling fine. Something else changed.

Lindenk · 2017-03-01T20:53:44Z

Hmm....I tried backtracking and using go-sqlite3 at f043f80, which was at the beginning of November with the same problem.

vorlif · 2017-03-01T21:18:40Z

After checkout the revision b5c99a7 (2017-08-21) the compilation is working.

Lindenk · 2017-03-01T21:28:42Z

Does it look like 98981b4 is the commit that breaks cross-compiling on go 1.8?

mattn · 2017-03-02T00:07:55Z

@FiloSottile It seems related with your commit. Can you handle this issue? If it was temporary issue for some version of go, I'll revert the commit. Thanks.

vorlif · 2017-03-02T15:05:53Z

No, I don't think that 98981b4 is the breaking point. Firstly, the commit 5811704 to undo the changes. Secondly, the cross compilation does not work with both versions.

If I checkout the revision b5c99a7 the cross compilation works. But the binary does not work. I'm not sure if this a problem of version mixing (go-sqlite supports only go 1.6 on this point but I use go 1.8) or a problem of the cross compilation.

@mattn Should it be possible to cross compile go-sqlite without enabled CGO?

mattn · 2017-03-03T00:53:04Z

Should it be possible to cross compile go-sqlite without enabled CGO?

go-sqlite3 is CGO module. So you need to enable CGO always.

Lindenk · 2017-03-03T01:56:54Z

Huh, I'm surprised. It seemed to be compiling and running fine until go 1.8. I'm not why then.

vorlif · 2017-03-03T14:33:58Z

go-sqlite3 is CGO module. So you need to enable CGO always.

Then we can close the issue from my point of view.

I have tried to cross compile without CGO. This can not work.

dcwangmit01 · 2017-03-30T03:24:16Z

I experienced the same problems as described by this thread, but I was eventually able to get things to work.

From a linux amd64 host, I was finally able to cross compile for linux arm. Posting below, in case it may be useful for anyone.

## Building ARM Binary
export GOOS=linux; \
export GOARCH=arm; \
export GOARM=7; \
export CC=arm-linux-gnueabihf-gcc-5; \
CGO_ENABLED=1 go build -ldflags "-linkmode external -extldflags -static" \
  -o "./bin/${GOOS}_${GOARCH}/the_app"

gabrielruiu · 2017-09-09T11:04:44Z

@dcwangmit01 what package did you install to make arm-linux-gnueabihf-gcc-5 available on your system?

rolurq · 2017-09-20T19:37:05Z

@gabrielruiu install gcc-5-arm-linux-gnueabihf.
That package is not available on debian 9 (stretch) so I used gcc-6-arm-linux-gnueabihf, which worked fine for me, I just had to change CC=arm-linux-gnueabihf-gcc-6.

gertcuykens · 2017-10-03T12:35:15Z

Can't find the correct compiler arguments for OSX to linux using the clang compiler, help greatly appreciated thx

% env GOOS=linux CGO_ENABLED=1 go build -ldflags "-linkmode external -extldflags -static"
# runtime/cgo
ld: unknown option: --build-id=none
clang: error: linker command failed with exit code 1 (use -v to see invocation)

% env GOOS=linux CGO_ENABLED=1 go build
# runtime/cgo
ld: unknown option: --build-id=none
clang: error: linker command failed with exit code 1 (use -v to see invocation)

gertcuykens · 2017-10-24T19:14:12Z

No ended up using another linux docker container and compile it in that docker container instead. Sad that c compilers still make life hard even today for just a few parameters

cosmosinnovate · 2018-05-05T02:50:29Z

I have the same problem. I can see errors.

mattn · 2018-05-13T13:42:52Z

What is bad? sqlite3 is written in C code. so You MUST use CGO.

carosatig · 2018-10-27T02:48:54Z

I succeeded to cross compile from macos to linux using musl-cross.
brew install FiloSottile/musl-cross/musl-cross

using this command line:

CC=x86_64-linux-musl-gcc CXX=x86_64-linux-musl-g++ GOARCH=amd64 GOOS=linux CGO_ENABLED=1 go build -ldflags "-linkmode external -extldflags -static"

Hope this helps others.

matthewmueller · 2018-11-29T16:50:52Z

@carosatig just what I was looking for! thanks for figuring that out for us.

i'm not too familiar with the cgo compilation process, do you mind explaining why -ldflags "-linkmode external -extldflags -static" is needed?

sungwoncho · 2018-12-02T04:41:49Z

I am cross compiling using xgo. Here is my working solution https://github.com/dnote/cli/blob/fa1da50fc5f8f9ef9df23a35a86e497ed9a9bbff/scripts/build.sh#L31-L60 in case it helps anyone.

microidea · 2019-01-23T13:06:18Z

I succeeded to cross compile from macos to linux using musl-cross.
brew install FiloSottile/musl-cross/musl-cross

using this command line:

CC=x86_64-linux-musl-gcc CXX=x86_64-linux-musl-g++ GOARCH=amd64 GOOS=linux CGO_ENABLED=1 go build -ldflags "-linkmode external -extldflags -static"

Hope this helps others.

THANKS! Really saved my day~
For those who want to compile ARM like Raspberry pi:
brew install FiloSottile/musl-cross/musl-cross --without-x86_64 --with-arm-hf
You can also use --with-i486 (x86 32-bit), --with-aarch64 (ARM 64-bit), --with-arm (ARM soft-float) and --with-mips.
But it takes a lot of time: on my old Mac built in 174 minutes 44 seconds
BTW, my build command is CC=arm-linux-musleabihf-gcc CXX=arm-linux-musleabihf-g++ GOARCH=arm GOARM=7 GOOS=linux CGO_ENABLED=1 go build -ldflags "-linkmode external -extldflags -static" xxx.go

hongjinlin · 2019-05-09T09:34:20Z

CC=mips-linux-musl-gcc CXX=mips-linux-musl-g++ CGO_ENABLED=1 GOOS=linux GOARCH=mipsle GOMIPS=softfloat go build -ldflags="-s -w" main.go

How can i build for little endian?Thank you!
If i change "GOARCH=mipsle" To "GOARCH=mips" is ok, but my target is little endian~

rittneje · 2019-05-09T11:23:48Z

You should probably open a new issue rather than commenting on one that’s already been closed. Please include the actual problem you’ve encountered. If it’s failing to compile, please include any error messages.

hongjinlin · 2019-05-09T13:46:18Z

You should probably open a new issue rather than commenting on one that’s already been closed. Please include the actual problem you’ve encountered. If it’s failing to compile, please include any error messages.

ok , thank you!

sosoyososo · 2020-03-30T04:55:43Z

compiling for linux on macOS can refer this solution #797

vishnukvmd · 2020-04-09T23:05:05Z

@carosatig 's comment was quite helpful in resolving compilation issues on OSX. I'd recommend documenting this.

@mattn Please let me know if you would be okay with me creating a PR that appends this information to README.md.

mattn · 2020-04-16T05:41:24Z

Yes, please.

Inspiration: mattn#384 (comment)

vishnukvmd · 2020-04-22T14:01:39Z

@mattn Here you go: #804

* Document requirements for cross compiling from OSX Inspiration: #384 (comment) * Document cross compilation steps using xgo for MACOSX

peterwillcn · 2020-05-27T08:45:27Z

Good

esell mentioned this issue Feb 22, 2017

Cross compile OSX -> linux with sqlite tag fails go-gitea/gitea#1011

Closed

6 tasks

mattn closed this as completed Mar 3, 2017

SuperQ mentioned this issue May 4, 2017

Bug: current and power values are always 0. nDenerserve/SmartPi#27

Closed

caseylucas mentioned this issue May 31, 2017

cannot cross compile with sqlite support rubenv/sql-migrate#78

Open

maxvw mentioned this issue Jun 5, 2017

adapted the sqlite driver for v3 (#165) mattes/migrate#238

Merged

hoop33 mentioned this issue Jun 7, 2017

Cross-compilation doesn't work hoop33/limo#62

Open

MrSaints mentioned this issue Oct 30, 2017

Enhancements: configurable database file path, default port, and optimised Docker image adtac/commento#109

Merged

limboinf mentioned this issue Jan 4, 2018

Cross build with cgo error limboinf/ydao#1

Open

otiai10 mentioned this issue Feb 14, 2018

Unable to compile for windows on macOS. Says first call to package not found otiai10/gosseract#112

Closed

vkuznecovas mentioned this issue Apr 21, 2018

Problems when building the binary vkuznecovas/mouthful#47

Closed

hongjinlin mentioned this issue May 9, 2019

build for mipsle failed #715

Closed

flyskywhy mentioned this issue Jun 6, 2019

Can't textile init on ARM Linux textileio/go-textile#805

Open

nikukyugamer mentioned this issue Dec 17, 2019

In case of SQLite3 database on Mac, it doesn't work sue445/plant_erd#48

Closed

vishnukvmd pushed a commit to vishnukvmd/go-sqlite3 that referenced this issue Apr 17, 2020

Document requirements for cross compiling from OSX

fe73920

Inspiration: mattn#384 (comment)

vishnukvmd pushed a commit to vishnukvmd/go-sqlite3 that referenced this issue Apr 17, 2020

Document requirements for cross compiling from OSX

3c9cdd2

Inspiration: mattn#384 (comment)

vishnukvmd mentioned this issue Apr 17, 2020

Document requirements for cross compiling from OSX #804

Merged

mattn pushed a commit that referenced this issue May 15, 2020

Document requirements for cross compiling from OSX (#804)

e77f7dd

* Document requirements for cross compiling from OSX Inspiration: #384 (comment) * Document cross compilation steps using xgo for MACOSX

matthewmueller mentioned this issue Aug 4, 2020

Cross-compile for Linux? rogchap/v8go#35

Closed

trawler mentioned this issue Apr 12, 2021

K0s backup k0sproject/k0s#835

Merged

6 tasks

tigh-latte mentioned this issue May 18, 2023

Enhancement: arm64 robherley/snips.sh#42

Merged

matthewmueller mentioned this issue May 19, 2023

undefined: sqlite3.Error issue livebud/bud#405

Open

Cross compiling fails #384

Cross compiling fails #384

Comments

samhh commented Feb 21, 2017

mattn commented Feb 21, 2017

samhh commented Feb 21, 2017

mattn commented Feb 21, 2017

samhh commented Feb 21, 2017

mattn commented Feb 21, 2017 • edited

samhh commented Feb 22, 2017

vorlif commented Feb 22, 2017

mattn commented Feb 23, 2017

vorlif commented Feb 23, 2017 • edited

mattn commented Feb 23, 2017

Lindenk commented Mar 1, 2017

rusenask commented Mar 1, 2017

Lindenk commented Mar 1, 2017

vorlif commented Mar 1, 2017 • edited

Lindenk commented Mar 1, 2017

mattn commented Mar 2, 2017

vorlif commented Mar 2, 2017

mattn commented Mar 3, 2017

Lindenk commented Mar 3, 2017

vorlif commented Mar 3, 2017

dcwangmit01 commented Mar 30, 2017 • edited

gabrielruiu commented Sep 9, 2017

rolurq commented Sep 20, 2017 • edited

gertcuykens commented Oct 3, 2017

gertcuykens commented Oct 24, 2017

cosmosinnovate commented May 5, 2018

mattn commented May 13, 2018

carosatig commented Oct 27, 2018

matthewmueller commented Nov 29, 2018

sungwoncho commented Dec 2, 2018

microidea commented Jan 23, 2019 • edited

hongjinlin commented May 9, 2019

rittneje commented May 9, 2019

hongjinlin commented May 9, 2019

sosoyososo commented Mar 30, 2020 • edited

vishnukvmd commented Apr 9, 2020

mattn commented Apr 16, 2020

vishnukvmd commented Apr 22, 2020

peterwillcn commented May 27, 2020

mattn commented Feb 21, 2017 •

edited

vorlif commented Feb 23, 2017 •

edited

vorlif commented Mar 1, 2017 •

edited

dcwangmit01 commented Mar 30, 2017 •

edited

rolurq commented Sep 20, 2017 •

edited

microidea commented Jan 23, 2019 •

edited

sosoyososo commented Mar 30, 2020 •

edited