{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":693482555,"defaultBranch":"master","name":"spark","ownerLogin":"zeotuan","currentUserCanPush":false,"isFork":true,"isEmpty":false,"createdAt":"2023-09-19T05:49:25.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/48720253?v=4","public":true,"private":false,"isOrgOwned":false},"refInfo":{"name":"","listCacheKey":"v0:1716039182.0","currentOid":""},"activityList":{"items":[{"before":"32d0cd21c1382229104c272ede8f9c0f56eaaa4f","after":"f1ed4f230204326c08c7be2fb96a0065ff746dc8","ref":"refs/heads/coreInfo3","pushedAt":"2024-05-29T17:07:05.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"gengliangwang","name":"Gengliang Wang","path":"/gengliangwang","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1097932?s=80&v=4"},"commit":{"message":"Update common/utils/src/main/scala/org/apache/spark/internal/LogKey.scala","shortMessageHtmlLink":"Update common/utils/src/main/scala/org/apache/spark/internal/LogKey.s…"}},{"before":"a408ebc9e1f034fdc1ab251589501d9db8f0ab5b","after":"32d0cd21c1382229104c272ede8f9c0f56eaaa4f","ref":"refs/heads/coreInfo3","pushedAt":"2024-05-29T06:39:38.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"zeotuan","name":null,"path":"/zeotuan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/48720253?s=80&v=4"},"commit":{"message":"Reorder import","shortMessageHtmlLink":"Reorder import"}},{"before":"e970298bca138aecca9f688371511146fd3b3389","after":"a408ebc9e1f034fdc1ab251589501d9db8f0ab5b","ref":"refs/heads/coreInfo3","pushedAt":"2024-05-29T05:04:35.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"zeotuan","name":null,"path":"/zeotuan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/48720253?s=80&v=4"},"commit":{"message":"Reorder import","shortMessageHtmlLink":"Reorder import"}},{"before":"7865b7281e11ce7cd2ee455266ca6ddd48109d84","after":"e970298bca138aecca9f688371511146fd3b3389","ref":"refs/heads/coreInfo3","pushedAt":"2024-05-29T04:30:08.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"zeotuan","name":null,"path":"/zeotuan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/48720253?s=80&v=4"},"commit":{"message":"fix ambiguous import. Remove unused key","shortMessageHtmlLink":"fix ambiguous import. Remove unused key"}},{"before":"6db64bd8b3b35df1b48a4f6e8300f48ae983592f","after":"7865b7281e11ce7cd2ee455266ca6ddd48109d84","ref":"refs/heads/coreInfo3","pushedAt":"2024-05-29T02:59:02.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"zeotuan","name":null,"path":"/zeotuan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/48720253?s=80&v=4"},"commit":{"message":"Fix key ordering","shortMessageHtmlLink":"Fix key ordering"}},{"before":"cb0b9803674f6554c7d98c1cb6ce05f13144b77c","after":"6db64bd8b3b35df1b48a4f6e8300f48ae983592f","ref":"refs/heads/coreInfo3","pushedAt":"2024-05-29T02:57:36.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"zeotuan","name":null,"path":"/zeotuan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/48720253?s=80&v=4"},"commit":{"message":"Resolve review","shortMessageHtmlLink":"Resolve review"}},{"before":"d214b310b22de8c42af1f71634e48bcd3b76e424","after":"cb0b9803674f6554c7d98c1cb6ce05f13144b77c","ref":"refs/heads/coreInfo3","pushedAt":"2024-05-25T05:56:18.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"zeotuan","name":null,"path":"/zeotuan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/48720253?s=80&v=4"},"commit":{"message":"Migrate to structure logging","shortMessageHtmlLink":"Migrate to structure logging"}},{"before":"9ad231bbd75756ab3e576466447387650209f451","after":"d214b310b22de8c42af1f71634e48bcd3b76e424","ref":"refs/heads/coreInfo3","pushedAt":"2024-05-25T05:35:28.000Z","pushType":"push","commitsCount":17,"pusher":{"login":"zeotuan","name":null,"path":"/zeotuan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/48720253?s=80&v=4"},"commit":{"message":"Merge master","shortMessageHtmlLink":"Merge master"}},{"before":"4a471cceebedd938f781eb385162d33058124092","after":"416d7f24fc354e912773ceb160210ad6a0c5fe99","ref":"refs/heads/master","pushedAt":"2024-05-25T04:22:06.000Z","pushType":"push","commitsCount":16,"pusher":{"login":"zeotuan","name":null,"path":"/zeotuan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/48720253?s=80&v=4"},"commit":{"message":"[SPARK-48239][INFRA][FOLLOWUP] install the missing `jq` library\n\n### What changes were proposed in this pull request?\n\nThis is a followup of https://github.com/apache/spark/pull/46534 . We missed the `jq` library which is needed to create git tags.\n\n### Why are the changes needed?\n\nfix bug\n\n### Does this PR introduce _any_ user-facing change?\n\nno\n\n### How was this patch tested?\n\nmanual\n\n### Was this patch authored or co-authored using generative AI tooling?\n\nno\n\nCloses #46743 from cloud-fan/script.\n\nAuthored-by: Wenchen Fan <wenchen@databricks.com>\nSigned-off-by: Wenchen Fan <wenchen@databricks.com>","shortMessageHtmlLink":"[SPARK-48239][INFRA][FOLLOWUP] install the missing <code>jq</code> library"}},{"before":"ed4624e00cf3deb05cb20a8485d8355167d4ee13","after":"9ad231bbd75756ab3e576466447387650209f451","ref":"refs/heads/coreInfo3","pushedAt":"2024-05-24T01:52:30.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"zeotuan","name":null,"path":"/zeotuan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/48720253?s=80&v=4"},"commit":{"message":"Order LogKeys","shortMessageHtmlLink":"Order LogKeys"}},{"before":"06e7f7efb8be4d4d4815a705bd9dc39b5f3d4d9f","after":"ed4624e00cf3deb05cb20a8485d8355167d4ee13","ref":"refs/heads/coreInfo3","pushedAt":"2024-05-24T00:52:40.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"zeotuan","name":null,"path":"/zeotuan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/48720253?s=80&v=4"},"commit":{"message":"Fix formatting","shortMessageHtmlLink":"Fix formatting"}},{"before":"13377715a25783db14ff381b07dffa1d9a9ba3a3","after":"06e7f7efb8be4d4d4815a705bd9dc39b5f3d4d9f","ref":"refs/heads/coreInfo3","pushedAt":"2024-05-23T23:10:41.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"zeotuan","name":null,"path":"/zeotuan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/48720253?s=80&v=4"},"commit":{"message":"Fix formatting","shortMessageHtmlLink":"Fix formatting"}},{"before":"85a560f9f75c34556c82b7bb4e792b2390aac6c9","after":"13377715a25783db14ff381b07dffa1d9a9ba3a3","ref":"refs/heads/coreInfo3","pushedAt":"2024-05-23T22:58:49.000Z","pushType":"push","commitsCount":55,"pusher":{"login":"zeotuan","name":null,"path":"/zeotuan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/48720253?s=80&v=4"},"commit":{"message":"Merge branch 'master' of https://github.com/zeotuan/spark into coreInfo3","shortMessageHtmlLink":"Merge branch 'master' of <a href=\"https://github.com/zeotuan/spark\">https://github.com/zeotuan/spark</a> into coreInfo3"}},{"before":"74a1a76e811a0b6953468dc59b0f258fbd4d7691","after":"4a471cceebedd938f781eb385162d33058124092","ref":"refs/heads/master","pushedAt":"2024-05-23T22:41:01.000Z","pushType":"push","commitsCount":54,"pusher":{"login":"zeotuan","name":null,"path":"/zeotuan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/48720253?s=80&v=4"},"commit":{"message":"[MINOR][TESTS] Add a helper function for `spark.table` in dsl\n\n### What changes were proposed in this pull request?\nAdd a helper function for `spark.table` in dsl\n\n### Why are the changes needed?\nto be used in tests\n\n### Does this PR introduce _any_ user-facing change?\nno, test only\n\n### How was this patch tested?\nci\n\n### Was this patch authored or co-authored using generative AI tooling?\nno\n\nCloses #46717 from zhengruifeng/dsl_read.\n\nAuthored-by: Ruifeng Zheng <ruifengz@apache.org>\nSigned-off-by: Ruifeng Zheng <ruifengz@apache.org>","shortMessageHtmlLink":"[MINOR][TESTS] Add a helper function for <code>spark.table</code> in dsl"}},{"before":"3631a0484619b2549b5bd3817543bda91e2049e9","after":"85a560f9f75c34556c82b7bb4e792b2390aac6c9","ref":"refs/heads/coreInfo3","pushedAt":"2024-05-23T22:40:09.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"zeotuan","name":null,"path":"/zeotuan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/48720253?s=80&v=4"},"commit":{"message":"Migrate to structured logging","shortMessageHtmlLink":"Migrate to structured logging"}},{"before":null,"after":"3631a0484619b2549b5bd3817543bda91e2049e9","ref":"refs/heads/coreInfo3","pushedAt":"2024-05-18T13:33:02.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"zeotuan","name":null,"path":"/zeotuan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/48720253?s=80&v=4"},"commit":{"message":"Migrate to structured logging","shortMessageHtmlLink":"Migrate to structured logging"}},{"before":"7441bd0197e6442c4f98481bf2fb23b49b5f75cf","after":"74a1a76e811a0b6953468dc59b0f258fbd4d7691","ref":"refs/heads/master","pushedAt":"2024-05-17T05:41:56.000Z","pushType":"push","commitsCount":44,"pusher":{"login":"zeotuan","name":null,"path":"/zeotuan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/48720253?s=80&v=4"},"commit":{"message":"[MINOR][PYTHON][TESTS] Call `test_apply_schema_to_dict_and_rows` in `test_apply_schema_to_row`\n\n### What changes were proposed in this pull request?\n\nThis PR fixes the test `test_apply_schema_to_row` to call `test_apply_schema_to_row` instead of `test_apply_schema_to_dict_and_rows`. It was a mistake.\n\n### Why are the changes needed?\n\nTo avoid a mistake when it's enabled in the future.\n\n### Does this PR introduce _any_ user-facing change?\n\nNo, test-only\n\n### How was this patch tested?\n\nCI in this PR.\n\n### Was this patch authored or co-authored using generative AI tooling?\n\nNo.\n\nCloses #46631 from HyukjinKwon/minor-test-rename.\n\nAuthored-by: Hyukjin Kwon <gurwls223@apache.org>\nSigned-off-by: Hyukjin Kwon <gurwls223@apache.org>","shortMessageHtmlLink":"[MINOR][PYTHON][TESTS] Call <code>test_apply_schema_to_dict_and_rows</code> in `…"}},{"before":"7e79e91dc8c531ee9135f0e32a9aa2e1f80c4bbf","after":"7441bd0197e6442c4f98481bf2fb23b49b5f75cf","ref":"refs/heads/master","pushedAt":"2024-05-15T03:17:37.000Z","pushType":"push","commitsCount":79,"pusher":{"login":"zeotuan","name":null,"path":"/zeotuan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/48720253?s=80&v=4"},"commit":{"message":"[SPARK-48274][BUILD] Upgrade GenJavadoc to `0.19`\n\n### What changes were proposed in this pull request?\nThis PR upgrades `GenJavadoc` plugin from `0.18` to `0.19`.\n\n### Why are the changes needed?\n1.The full release notes: https://github.com/lightbend/genjavadoc/releases/tag/v0.19\n\n2.The latest version supports scala `2.13.14`, which is a `prerequisite` for us to upgrade spark's scala `2.13.14`.\nhttps://mvnrepository.com/artifact/com.typesafe.genjavadoc/genjavadoc-plugin\n\n3.The last upgrade occurred 3 years ago https://github.com/apache/spark/pull/33383\n\n### Does this PR introduce _any_ user-facing change?\nNo.\n\n### How was this patch tested?\nBuilt the doc:\n\n```\n./build/sbt -Phadoop-3 -Pkubernetes -Pkinesis-asl -Phive-thriftserver -Pdocker-integration-tests -Pyarn -Phadoop-cloud -Pspark-ganglia-lgpl -Phive -Pjvm-profiler unidoc\n```\n<img width=\"501\" alt=\"image\" src=\"https://github.com/apache/spark/assets/15246973/58d3fac8-c968-44e0-83f3-84cf00a5084f\">\n\n### Was this patch authored or co-authored using generative AI tooling?\nNo.\n\nCloses #46579 from panbingkun/unidocGenjavadocVersion_0_19.\n\nAuthored-by: panbingkun <panbingkun@baidu.com>\nSigned-off-by: yangjie01 <yangjie01@baidu.com>","shortMessageHtmlLink":"[SPARK-48274][BUILD] Upgrade GenJavadoc to <code>0.19</code>"}},{"before":"97d70f5addd17c86cac00e58292773eb4161dae4","after":"a3c3009f5ff851ba797d004e12d03973a4357155","ref":"refs/heads/coreInfo2","pushedAt":"2024-05-14T18:01:41.000Z","pushType":"push","commitsCount":101,"pusher":{"login":"gengliangwang","name":"Gengliang Wang","path":"/gengliangwang","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1097932?s=80&v=4"},"commit":{"message":"Merge branch 'master' into coreInfo2","shortMessageHtmlLink":"Merge branch 'master' into coreInfo2"}},{"before":"eaf09c93c5890cdf4772bce27ab979f01ecb62ee","after":"97d70f5addd17c86cac00e58292773eb4161dae4","ref":"refs/heads/coreInfo2","pushedAt":"2024-05-14T12:45:20.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"zeotuan","name":null,"path":"/zeotuan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/48720253?s=80&v=4"},"commit":{"message":"Improve Log key","shortMessageHtmlLink":"Improve Log key"}},{"before":"1449b1fe49dd8e988791b2f4e55af301958543cf","after":"eaf09c93c5890cdf4772bce27ab979f01ecb62ee","ref":"refs/heads/coreInfo2","pushedAt":"2024-05-14T01:16:59.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"zeotuan","name":null,"path":"/zeotuan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/48720253?s=80&v=4"},"commit":{"message":"Use more general key","shortMessageHtmlLink":"Use more general key"}},{"before":"f0e8039d41cdaff706a223cb27026c7af8c96d6a","after":"1449b1fe49dd8e988791b2f4e55af301958543cf","ref":"refs/heads/coreInfo2","pushedAt":"2024-05-13T23:50:15.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"zeotuan","name":null,"path":"/zeotuan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/48720253?s=80&v=4"},"commit":{"message":"Remove redundant unit log","shortMessageHtmlLink":"Remove redundant unit log"}},{"before":"29bd8666adb0c1cdcac1d38b42de08854d515e42","after":"f0e8039d41cdaff706a223cb27026c7af8c96d6a","ref":"refs/heads/coreInfo2","pushedAt":"2024-05-11T06:16:07.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"zeotuan","name":null,"path":"/zeotuan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/48720253?s=80&v=4"},"commit":{"message":"Revert command print","shortMessageHtmlLink":"Revert command print"}},{"before":"48d9a004389ddacf763536b1e6b4178840cf115a","after":"29bd8666adb0c1cdcac1d38b42de08854d515e42","ref":"refs/heads/coreInfo2","pushedAt":"2024-05-09T22:28:53.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"zeotuan","name":null,"path":"/zeotuan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/48720253?s=80&v=4"},"commit":{"message":"Reorder LogKeys","shortMessageHtmlLink":"Reorder LogKeys"}},{"before":"a640e45e081908284cdfa22df7eb96d4335005d7","after":"48d9a004389ddacf763536b1e6b4178840cf115a","ref":"refs/heads/coreInfo2","pushedAt":"2024-05-09T06:29:57.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"zeotuan","name":null,"path":"/zeotuan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/48720253?s=80&v=4"},"commit":{"message":"Fix formatting","shortMessageHtmlLink":"Fix formatting"}},{"before":"766f029325735756d014397f07f4c258adff3694","after":"a640e45e081908284cdfa22df7eb96d4335005d7","ref":"refs/heads/coreInfo2","pushedAt":"2024-05-09T06:14:41.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"zeotuan","name":null,"path":"/zeotuan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/48720253?s=80&v=4"},"commit":{"message":"Fix formatting","shortMessageHtmlLink":"Fix formatting"}},{"before":"8b14e78cc30bd36a68ceb5f878cf48dd66c27a54","after":"766f029325735756d014397f07f4c258adff3694","ref":"refs/heads/coreInfo2","pushedAt":"2024-05-09T05:09:19.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"zeotuan","name":null,"path":"/zeotuan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/48720253?s=80&v=4"},"commit":{"message":"Migrate core logInfo","shortMessageHtmlLink":"Migrate core logInfo"}},{"before":"67ae23934b56761617c2fb217ae6cf6f2d8f619b","after":"7e79e91dc8c531ee9135f0e32a9aa2e1f80c4bbf","ref":"refs/heads/master","pushedAt":"2024-05-09T04:41:05.000Z","pushType":"push","commitsCount":26,"pusher":{"login":"zeotuan","name":null,"path":"/zeotuan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/48720253?s=80&v=4"},"commit":{"message":"[SPARK-48197][SQL] Avoid assert error for invalid lambda function\n\n### What changes were proposed in this pull request?\n\n`ExpressionBuilder` asserts all its input expressions to be resolved during lookup, which is not true as the analyzer rule `ResolveFunctions` can trigger function lookup even if the input expression contains unresolved lambda functions.\n\nThis PR updates that assert to check non-lambda inputs only, and fail earlier if the input contains lambda functions. In the future, if we use `ExpressionBuilder` to register higher-order functions, we can relax it.\n\n### Why are the changes needed?\n\nbetter error message\n\n### Does this PR introduce _any_ user-facing change?\n\nno, only changes error message\n\n### How was this patch tested?\n\nnew test\n\n### Was this patch authored or co-authored using generative AI tooling?\n\nno\n\nCloses #46475 from cloud-fan/minor.\n\nAuthored-by: Wenchen Fan <wenchen@databricks.com>\nSigned-off-by: Wenchen Fan <wenchen@databricks.com>","shortMessageHtmlLink":"[SPARK-48197][SQL] Avoid assert error for invalid lambda function"}},{"before":"ee0c1a81914e004a507a6162f0a7d05ef50722a3","after":"8b14e78cc30bd36a68ceb5f878cf48dd66c27a54","ref":"refs/heads/coreInfo2","pushedAt":"2024-05-09T00:26:36.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"zeotuan","name":null,"path":"/zeotuan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/48720253?s=80&v=4"},"commit":{"message":"migrate coreInfo structure Logging 2.1","shortMessageHtmlLink":"migrate coreInfo structure Logging 2.1"}},{"before":null,"after":"ee0c1a81914e004a507a6162f0a7d05ef50722a3","ref":"refs/heads/coreInfo2","pushedAt":"2024-05-08T07:29:40.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"zeotuan","name":null,"path":"/zeotuan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/48720253?s=80&v=4"},"commit":{"message":"migrate coreInfo structure Logging 2","shortMessageHtmlLink":"migrate coreInfo structure Logging 2"}}],"hasNextPage":true,"hasPreviousPage":false,"activityType":"all","actor":null,"timePeriod":"all","sort":"DESC","perPage":30,"cursor":"djE6ks8AAAAEVzO4cgA","startCursor":null,"endCursor":null}},"title":"Activity · zeotuan/spark"}