{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":63484632,"defaultBranch":"main","name":"fastText","ownerLogin":"facebookresearch","currentUserCanPush":false,"isFork":false,"isEmpty":false,"createdAt":"2016-07-16T13:38:42.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/16943930?v=4","public":true,"private":false,"isOrgOwned":true},"refInfo":{"name":"","listCacheKey":"v0:1710336158.0","currentOid":""},"activityList":{"items":[{"before":"ae1fe80e9fbbe97d16214647310e2523327cecab","after":"1142dc4c4ecbc19cc16eee5cdd28472e689267e6","ref":"refs/heads/main","pushedAt":"2024-03-13T15:22:56.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"facebook-github-bot","name":"Facebook Community Bot","path":"/facebook-github-bot","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6422482?s=80&v=4"},"commit":{"message":"Delete .circleci directory (#1366)\n\nSummary: Pull Request resolved: https://github.com/facebookresearch/fastText/pull/1366\n\nReviewed By: jailby\n\nDifferential Revision: D54850920\n\nPulled By: bigfootjon\n\nfbshipit-source-id: 9a3eec7b7cb42335a786fb247cb16be9ed3c2d59","shortMessageHtmlLink":"Delete .circleci directory (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2184011473\" data-permission-text=\"Title is private\" data-url=\"https://github.com/facebookresearch/fastText/issues/1366\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/facebookresearch/fastText/pull/1366/hovercard\" href=\"https://github.com/facebookresearch/fastText/pull/1366\">#1366</a>)"}},{"before":null,"after":"61d8afd17a68ad22156992e1d2c6855374f0274e","ref":"refs/heads/bigfootjon-patch-1","pushedAt":"2024-03-13T13:22:38.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"bigfootjon","name":"Jon Janzen","path":"/bigfootjon","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6403568?s=80&v=4"},"commit":{"message":"Delete .circleci directory","shortMessageHtmlLink":"Delete .circleci directory"}},{"before":"b733943e84263f432fa47588643822194ee03dd1","after":"ae1fe80e9fbbe97d16214647310e2523327cecab","ref":"refs/heads/main","pushedAt":"2024-02-20T15:36:32.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"facebook-github-bot","name":"Facebook Community Bot","path":"/facebook-github-bot","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6422482?s=80&v=4"},"commit":{"message":"deeplearning/fastText 2/2\n\nReviewed By: azad-meta\n\nDifferential Revision: D53908330\n\nfbshipit-source-id: b2215f0522c32a82cd876633210befefe9317d76","shortMessageHtmlLink":"deeplearning/fastText 2/2"}},{"before":"6c2204ba66776b700095ff73e3e599a908ffd9c3","after":"b733943e84263f432fa47588643822194ee03dd1","ref":"refs/heads/main","pushedAt":"2024-01-09T17:31:49.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"facebook-github-bot","name":"Facebook Community Bot","path":"/facebook-github-bot","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6422482?s=80&v=4"},"commit":{"message":"Predict 1.9-4.2x faster (#1341)\n\nSummary:\nI made prediction 1.9x to 4.2x faster than before.\n\n# Motivation\nI want to use https://tinyurl.com/nllblid218e and similarly parametrized models to run language classification on petabytes of web data.\n\n# Methodology\nThe costliest operation is summing the rows for each model input.  I've optimized this in three ways:\n1. `addRowToVector` was a virtual function call for each row.  I've replaced this with one virtual function call per prediction by adding `averageRowsToVector` to `Matrix` calls.\n2. `Vector` and `DenseMatrix` were not 64-byte aligned so the CPU was doing a lot of unaligned memory access.  I've brought in my own `vector` replacement that does 64-byte alignment.\n3.  Write the `averageRowsToVector` in intrinsics for common vector sizes.  This works on SSE, AVX, and AVX512F.\n\nSee the commit history for a breakdown of speed improvement from each change.\n\n# Experiments\nTest set [docs1000.txt.gz](https://github.com/facebookresearch/fastText/files/11832996/docs1000.txt.gz) which is a bunch of random documents https://data.statmt.org/heafield/classified-fasttext/\nCPU: AMD Ryzen 9 7950X 16-Core\n\nModel https://tinyurl.com/nllblid218e with 256-dimensional vectors\nBefore\nreal    0m8.757s\nuser    0m8.434s\nsys     0m0.327s\n\nAfter\nreal    0m2.046s\nuser    0m1.717s\nsys     0m0.334s\n\nModel https://dl.fbaipublicfiles.com/fasttext/supervised-models/lid.176.bin with 16-dimensional vectors\nBefore\nreal    0m0.926s\nuser    0m0.889s\nsys     0m0.037s\n\nAfter\nreal    0m0.477s\nuser    0m0.436s\nsys     0m0.040s\n\nPull Request resolved: https://github.com/facebookresearch/fastText/pull/1341\n\nReviewed By: graemenail\n\nDifferential Revision: D52134736\n\nPulled By: kpuatfb\n\nfbshipit-source-id: 42067161f4c968c34612934b48a562399a267f3b","shortMessageHtmlLink":"Predict 1.9-4.2x faster (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"1769431069\" data-permission-text=\"Title is private\" data-url=\"https://github.com/facebookresearch/fastText/issues/1341\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/facebookresearch/fastText/pull/1341/hovercard\" href=\"https://github.com/facebookresearch/fastText/pull/1341\">#1341</a>)"}},{"before":"de458ddea42327cf314e69f9eef40d0ec02705ab","after":"6c2204ba66776b700095ff73e3e599a908ffd9c3","ref":"refs/heads/main","pushedAt":"2023-11-27T23:54:39.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"facebook-github-bot","name":"Facebook Community Bot","path":"/facebook-github-bot","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6422482?s=80&v=4"},"commit":{"message":"fix compile error with gcc13 #1281 (#1340)\n\nSummary:\nDue to[ header dependency changes](https://gcc.gnu.org/gcc-13/porting_to.html#header-dep-changes) in GCC 13, we need to include the <cstdint> header.\n\nPull Request resolved: https://github.com/facebookresearch/fastText/pull/1340\n\nReviewed By: jmp84\n\nDifferential Revision: D51602433\n\nPulled By: alexkosau\n\nfbshipit-source-id: cc9bffb276cb00f1db8ec97a36784c484ae4563a","shortMessageHtmlLink":"fix compile error with gcc13 <a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"1291293675\" data-permission-text=\"Title is private\" data-url=\"https://github.com/facebookresearch/fastText/issues/1281\" data-hovercard-type=\"issue\" data-hovercard-url=\"/facebookresearch/fastText/issues/1281/hovercard\" href=\"https://github.com/facebookresearch/fastText/issues/1281\">#1281</a> (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"1760144456\" data-permission-text=\"Title is private\" data-url=\"https://github.com/facebookresearch/fastText/issues/1340\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/facebookresearch/fastText/pull/1340/hovercard\" href=\"https://github.com/facebookresearch/fastText/pull/1340\">#1340</a>)"}},{"before":"789e32860d90ba097e4e2f9422225000fdea2b21","after":"de458ddea42327cf314e69f9eef40d0ec02705ab","ref":"refs/heads/main","pushedAt":"2023-11-27T23:50:23.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"facebook-github-bot","name":"Facebook Community Bot","path":"/facebook-github-bot","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6422482?s=80&v=4"},"commit":{"message":"Add pyproject.toml to comply with PEP-518 (#1292)\n\nSummary:\nAdds pyproject.toml to comply with PEP-518, which fixes the building of the library by poetry - See https://github.com/python-poetry/poetry/issues/6113 . This is a copy of https://github.com/facebookresearch/fastText/pull/1270 , but I have signed the CLA.\n\nPull Request resolved: https://github.com/facebookresearch/fastText/pull/1292\n\nDifferential Revision: D51601444\n\nPulled By: alexkosau\n\nfbshipit-source-id: 357d702281ca3519c3640483eba04d124d0744b4","shortMessageHtmlLink":"Add pyproject.toml to comply with PEP-518 (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"1333870441\" data-permission-text=\"Title is private\" data-url=\"https://github.com/facebookresearch/fastText/issues/1292\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/facebookresearch/fastText/pull/1292/hovercard\" href=\"https://github.com/facebookresearch/fastText/pull/1292\">#1292</a>)"}},{"before":"166ce2c71a497ff81cb62ec151be5b569e1f1be6","after":"789e32860d90ba097e4e2f9422225000fdea2b21","ref":"refs/heads/main","pushedAt":"2023-10-04T07:01:36.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"facebook-github-bot","name":"Facebook Community Bot","path":"/facebook-github-bot","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6422482?s=80&v=4"},"commit":{"message":"deeplearning, dcp (2972240286315620591)\n\nReviewed By: r-barnes\n\nDifferential Revision: D49677606\n\nfbshipit-source-id: ec5b375177586c76ecccb83a29b562bc6e9961f6","shortMessageHtmlLink":"deeplearning, dcp (2972240286315620591)"}},{"before":"440f46ac8811db0ce7ecb7dfb04f694453187db3","after":"166ce2c71a497ff81cb62ec151be5b569e1f1be6","ref":"refs/heads/main","pushedAt":"2023-08-25T22:37:22.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"facebook-github-bot","name":"Facebook Community Bot","path":"/facebook-github-bot","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6422482?s=80&v=4"},"commit":{"message":"Del `(object)` from 200 inc deeplearning/aicamera/trainer/utils/metrics.py\n\nSummary: Python3 makes the use of `(object)` in class inheritance unnecessary. Let's modernize our code by eliminating this.\n\nReviewed By: itamaro\n\nDifferential Revision: D48673901\n\nfbshipit-source-id: 3e0ef05efe886b32a07bb58bd0725fa2ec934c14","shortMessageHtmlLink":"Del <code>(object)</code> from 200 inc deeplearning/aicamera/trainer/utils/metri…"}},{"before":"48171ac6470f7b3638acc2699e0a370793d33fdd","after":"440f46ac8811db0ce7ecb7dfb04f694453187db3","ref":"refs/heads/main","pushedAt":"2023-06-21T07:21:24.492Z","pushType":"push","commitsCount":1,"pusher":{"login":"facebook-github-bot","name":"Facebook Community Bot","path":"/facebook-github-bot","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6422482?s=80&v=4"},"commit":{"message":"Migrate \"deeplearning/fastText\" from LLVM-12 to LLVM-15\n\nSummary:\nfbcode is migrating to LLVM-15 for safer and more up-to-date code and new compiler features. All contbuilds in your directory have passed our build test with LLVM-15, and your directory does not host any packages. This diff will migrate it to LLVM-15.\n\nIf you approve of this diff, please use the \"Accept & Ship\" button. If you have a reason for why it should not build with LLVM 15, please make a comment and send it back to author. Otherwise we will land this on Thursday 06/15/2023.\n\nSee the [FAQ post](https://fb.workplace.com/groups/llvm15platform010/posts/749154386769776/)! Please also direct any questions to [this group](https://fb.workplace.com/groups/llvm15platform010).\n\n - If you approve of this diff, please use the \"Accept & Ship\" button :-)\n\nReviewed By: meyering\n\nDifferential Revision: D46661531\n\nfbshipit-source-id: 7278fbfcadec2392c94efd6deb710bdd5e9280f8","shortMessageHtmlLink":"Migrate \"deeplearning/fastText\" from LLVM-12 to LLVM-15"}},{"before":"0622aad8571861d290b237e83e04e9a07a28839d","after":"48171ac6470f7b3638acc2699e0a370793d33fdd","ref":"refs/heads/main","pushedAt":"2023-06-07T04:30:54.363Z","pushType":"push","commitsCount":1,"pusher":{"login":"facebook-github-bot","name":"Facebook Community Bot","path":"/facebook-github-bot","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6422482?s=80&v=4"},"commit":{"message":"Add documentation about Hugging Face integration (#1335)\n\nSummary:\n[Word vectors](https://huggingface.co/facebook/fasttext-en-vectors) for 157 languages are now hosted on the Hugging Face Hub as well as the [language identification model](https://huggingface.co/facebook/fasttext-language-identification). (cc ajoulin)\n\nA newer language model [referred in the NLLB project](https://github.com/facebookresearch/fairseq/blob/nllb/README.md#lid-model) is not mentioned in the official website, so I updated the doc accordingly.\n\nPull Request resolved: https://github.com/facebookresearch/fastText/pull/1335\n\nReviewed By: Celebio\n\nDifferential Revision: D46507563\n\nPulled By: jmp84\n\nfbshipit-source-id: 64883a6829c68b968acd980ba77a712b8e7a1365","shortMessageHtmlLink":"Add documentation about Hugging Face integration (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"1739981830\" data-permission-text=\"Title is private\" data-url=\"https://github.com/facebookresearch/fastText/issues/1335\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/facebookresearch/fastText/pull/1335/hovercard\" href=\"https://github.com/facebookresearch/fastText/pull/1335\">#1335</a>)"}},{"before":"3697152e0fd772d9185697fdbd4a1d340ca5571d","after":"0622aad8571861d290b237e83e04e9a07a28839d","ref":"refs/heads/main","pushedAt":"2023-04-17T13:08:51.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"facebook-github-bot","name":"Facebook Community Bot","path":"/facebook-github-bot","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6422482?s=80&v=4"},"commit":{"message":"Replace outdated url in the scripts\n\nSummary: Replace outdated url in the scripts\n\nReviewed By: piotr-bojanowski\n\nDifferential Revision: D43464784\n\nfbshipit-source-id: 51a98a9ad5a0939acd0d578126290909a613938b","shortMessageHtmlLink":"Replace outdated url in the scripts"}}],"hasNextPage":false,"hasPreviousPage":false,"activityType":"all","actor":null,"timePeriod":"all","sort":"DESC","perPage":30,"cursor":"djE6ks8AAAAEFKOVGwA","startCursor":null,"endCursor":null}},"title":"Activity · facebookresearch/fastText"}