Create own partitioner #554

pawlyk · 2019-09-15T16:04:42Z

Port murmur2 from python-kafka and rewrite in cython for better performance.

# By pyup-bot (18) and others # Via GitHub (10) and pyup-bot (1) * master: (27 commits) Update sphinx from 2.1.2 to 2.2.0 Update gssapi from 1.5.1 to 1.6.1 Update docutils from 0.15 to 0.15.2 Update cython from 0.29.12 to 0.29.13 Update cython from 0.29.12 to 0.29.13 Update cython from 0.29.12 to 0.29.13 Update xxhash from 1.3.0 to 1.4.1 Update xxhash from 1.3.0 to 1.4.1 Update pytest from 5.0.1 to 5.1.2 Update pytest from 5.0.1 to 5.1.2 sugger --> sugar Fix typos, spelling, grammar, etc Fix typo in docs Fix documentation for benchmark Add backoff on fetcher Fix fstring for CRC Return run for all tests Update docutils from 0.14 to 0.15 Update cython from 0.29.11 to 0.29.12 Update cython from 0.29.11 to 0.29.12 ... # Conflicts: # benchmark/README

codecov · 2019-09-16T08:09:31Z

Codecov Report

Merging #554 into master will decrease coverage by 73.51%.
The diff coverage is 50%.

@@             Coverage Diff             @@
##           master     #554       +/-   ##
===========================================
- Coverage   98.42%   24.91%   -73.52%     
===========================================
  Files          31       34        +3     
  Lines        5017     5058       +41     
===========================================
- Hits         4938     1260     -3678     
- Misses         79     3798     +3719

Impacted Files	Coverage Δ
aiokafka/producer/producer.py	`22.44% <100%> (-77.05%)`	⬇️
aiokafka/partitioner/__init__.py	`100% <100%> (ø)`
aiokafka/partitioner/default.py	`38.46% <38.46%> (ø)`
aiokafka/partitioner/hashed.py	`43.47% <43.47%> (ø)`
aiokafka/consumer/group_coordinator.py	`9.51% <0%> (-89.66%)`	⬇️
aiokafka/consumer/fetcher.py	`10.55% <0%> (-86.3%)`	⬇️
aiokafka/producer/sender.py	`14.54% <0%> (-85%)`	⬇️
aiokafka/record/util.py	`14.13% <0%> (-84.79%)`	⬇️
aiokafka/cluster.py	`16.21% <0%> (-83.79%)`	⬇️
aiokafka/client.py	`14.64% <0%> (-83.44%)`	⬇️
... and 17 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update c0fa11f...e76f66f. Read the comment docs.

CLAassistant · 2020-11-16T10:15:50Z

Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.
0 out of 2 committers have signed the CLA.

❌ Pavel Stadnikov
❌ pawlyk

Pavel Stadnikov seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.
_{You have signed the CLA already but the status is still pending? Let us recheck it.}

Pavel Stadnikov and others added 7 commits July 26, 2019 17:09

add partitioner with murmur2 from kafka

986f9de

rewrite murmur2 to cython, use it in producer

2a2d467

fix typos

6221101

add benchmark

d0b018b

add some improvements

73e1e36

remove murmur.html

245f743

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Create own partitioner #554

Create own partitioner #554

pawlyk commented Sep 15, 2019

codecov bot commented Sep 16, 2019

CLAassistant commented Nov 16, 2020 •

edited

Create own partitioner #554

Are you sure you want to change the base?

Create own partitioner #554

Conversation

pawlyk commented Sep 15, 2019

codecov bot commented Sep 16, 2019

Codecov Report

CLAassistant commented Nov 16, 2020 • edited

CLAassistant commented Nov 16, 2020 •

edited