Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[BUG]: arm64 inconsistencies #2027

Open
dezren39 opened this issue Oct 29, 2023 · 1 comment
Open

[BUG]: arm64 inconsistencies #2027

dezren39 opened this issue Oct 29, 2023 · 1 comment
Labels
kind/bug Something is broken.

Comments

@dezren39
Copy link

What version of Badger are you using?

v3.2103.2

What version of Go are you using?

charmbracelet/charm#32

Have you tried reproducing the issue with the latest release?

No

What is the hardware spec (RAM, CPU, OS)?

arm64

What steps will reproduce the bug?

try to open
try to open again
it errors

Expected behavior and actual result.

try to open
try to open again
it doesn't error on second try

Additional information

Error: while opening memtables error: while opening fid: 3 error: while updating skiplist error: mremap size mismatch: r

charmbracelet/charm#242

Error: During db.vlog.open error: while truncating last value log file: /root/.local/share/charm/cloud.charm.sh/kv/charm.sh.kv.user.default/000004.vlog error: mremap size mismatch: requested: 20 got: 20000000

Error: while opening memtables error: while opening fid: 9 error: while updating skiplist error: mremap size mismatch: requested: 20 got: 134217728

Error: while opening memtables error: while opening fid: 2 error: while updating skiplist error: mremap size mismatch: requested: 20 got: 134217728

Error: while opening memtables error: while opening fid: 1 error: while updating skiplist error: mremap size mismatch: requested: 148 got: 134217728
@dezren39 dezren39 added the kind/bug Something is broken. label Oct 29, 2023
@dkorunic
Copy link

I have hit this same issue with github.com/dgraph-io/badger/v4@v4.2.0 on both ARM32 and ARM64 architecture, resulting in data corruption:

Unable to open database: could not open database: while opening memtables error: while opening fid: 1 error: while updating skiplist error: mremap size mismatch: requested: 20 got: 134217728"

From what I see, similar issues in Ristretto are most likely related:

@requilence requilence mentioned this issue Dec 9, 2023
Merged
mangalaman93 pushed a commit to dgraph-io/ristretto that referenced this issue Dec 11, 2023
@requilence
Disable mmap size check on arm arch as well as arm64 (#366)
a9fc219 
In #281 mmap size check has been disabled for the ARM64 arch. 

But we at [anytype](https://github.com/anyproto) quite often face the
same problem on the arm arch on Android devices (armeabi-v7a target)
with the [latest badger
v4.2.0](https://github.com/dgraph-io/badger/releases/tag/v4.2.0) and
[latest ristretto v0.1.1](https://github.com/dgraph-io/ristretto).

```memtables error: while opening fid: 1 error: while updating skiplist error: mremap size mismatch: requested: 1479692 got: 67108864```

This PR extends the #281 to cover all arm architectures.

Here is one more mention of this issue
dgraph-io/badger#2027 (comment)

It would also make sense to create the PR on top of v0.1.1 release, but there is not release branch to base on
This was referenced Feb 6, 2024
Open
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
kind/bug Something is broken.
Milestone
No milestone
Development

No branches or pull requests
2 participants
@dkorunic @dezren39