Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

com.hazelcast.jet.sql.impl.connector.kafka.SqlAvroTest and com.hazelcast.jet.kafka.impl.WriteKafkaPTest failed on Redpanda #26307

Open
olukas opened this issue Apr 8, 2024 · 2 comments
Open

com.hazelcast.jet.sql.impl.connector.kafka.SqlAvroTest and com.hazelcast.jet.kafka.impl.WriteKafkaPTest failed on Redpanda #26307

olukas opened this issue Apr 8, 2024 · 2 comments
Labels
Source: Internal PR or issue was opened by an employee Team: Integration Type: Test-Failure
Milestone
Backlog

Comments

@olukas
Copy link
Contributor

olukas commented Apr 8, 2024

master (commit f180f27199962fadab65a8a332a276d1215eb9f0)

Failed on Redpanda 23.3.z:

Following tests failed:

  • com.hazelcast.jet.kafka.impl.WriteKafkaPTest.when_recordLingerEnabled_then_sentOnCompletion
  • com.hazelcast.jet.kafka.impl.WriteKafkaPTest.test_resumeTransaction
  • com.hazelcast.jet.sql.impl.connector.kafka.SqlAvroTest.test_topLevelFieldExtraction[useSchemaRegistry=[false]]
  • com.hazelcast.jet.sql.impl.connector.kafka.SqlAvroTest.test_nonInclusiveUnion[useSchemaRegistry=[false]]
  • com.hazelcast.jet.sql.impl.connector.kafka.SqlAvroTest.test_keyAndValueSchemaAvailableInInformationSchema[useSchemaRegistry=[false]]
  • com.hazelcast.jet.kafka.impl.WriteKafkaPTest.testWriteToTopic
  • com.hazelcast.jet.sql.impl.connector.kafka.SqlAvroTest.test_nestedField[useSchemaRegistry=[true]]
  • com.hazelcast.jet.sql.impl.connector.kafka.SqlAvroTest.test_explicitKeyAndValueSerializers[useSchemaRegistry=[true]]
  • com.hazelcast.jet.sql.impl.connector.kafka.SqlAvroTest.test_allTypes[useSchemaRegistry=[true]]
  • com.hazelcast.jet.sql.impl.connector.kafka.SqlAvroTest.test_fieldsMapping[useSchemaRegistry=[true]]
  • com.hazelcast.jet.sql.impl.connector.kafka.SqlAvroTest.test_mappingAndTypeHasMissingOptionalField[useSchemaRegistry=[false]]
  • com.hazelcast.jet.sql.impl.connector.kafka.SqlAvroTest.test_nulls[useSchemaRegistry=[false]]
  • com.hazelcast.jet.sql.impl.connector.kafka.SqlAvroTest.test_nulls[useSchemaRegistry=[true]]
  • com.hazelcast.jet.sql.impl.connector.kafka.SqlAvroTest.test_topLevelFieldExtraction[useSchemaRegistry=[true]]
  • com.hazelcast.jet.sql.impl.connector.kafka.SqlAvroTest.test_schemaIdForTwoQueriesIsEqual[useSchemaRegistry=[true]]
  • com.hazelcast.jet.sql.impl.connector.kafka.SqlAvroTest.test_schemaEvolution[useSchemaRegistry=[false]]
  • com.hazelcast.jet.sql.impl.connector.kafka.SqlAvroTest.test_schemaEvolution[useSchemaRegistry=[true]]
Stacktrace: 
java.lang.RuntimeException: java.util.concurrent.ExecutionException: org.apache.kafka.common.errors.InvalidPartitionsException: Number of partitions is below 1.
	at com.hazelcast.jet.kafka.impl.KafkaTestSupport.createTopic(KafkaTestSupport.java:134)
	at com.hazelcast.jet.sql.impl.connector.kafka.KafkaSqlTestSupport.createRandomTopic(KafkaSqlTestSupport.java:90)
	at com.hazelcast.jet.sql.impl.connector.kafka.SqlAvroTest.createRandomTopic(SqlAvroTest.java:877)
	at com.hazelcast.jet.sql.impl.connector.kafka.SqlAvroTest.test_nestedField(SqlAvroTest.java:167)
	at java.base/java.lang.reflect.Method.invoke(Method.java:568)
	at com.hazelcast.test.FailOnTimeoutStatement$CallableStatement.call(FailOnTimeoutStatement.java:115)
	at com.hazelcast.test.FailOnTimeoutStatement$CallableStatement.call(FailOnTimeoutStatement.java:107)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.lang.Thread.run(Thread.java:842)
Caused by: java.util.concurrent.ExecutionException: org.apache.kafka.common.errors.InvalidPartitionsException: Number of partitions is below 1.
	at java.base/java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396)
	at java.base/java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073)
	at org.apache.kafka.common.internals.KafkaFutureImpl.get(KafkaFutureImpl.java:165)
	at com.hazelcast.jet.kafka.impl.KafkaTestSupport.createTopic(KafkaTestSupport.java:132)
	... 8 more
Caused by: org.apache.kafka.common.errors.InvalidPartitionsException: Number of partitions is below 1.
Standard output: 
Finished Running Test: test_unionWithString[useSchemaRegistry=[true]] in 0.002 seconds.
Started Running Test: test_nestedField[useSchemaRegistry=[true]]
21:32:49,177  INFO || - [DockerizedRedPandaTestSupport] docker-java-stream-785697843 - STDERR: INFO  2024-04-05 21:32:49,176 [shard 0:main] cluster - topics_frontend.cc:137 - Create topics {{configuration: { topic: {kafka/t_50082ddf_264a_4daa_b5da_b78363e62527}, partition_count: 4, replication_factor: 1, properties: {compression: {nullopt}, cleanup_policy_bitflags: {delete}, compaction_strategy: {nullopt}, retention_bytes: {}, retention_duration_ms: {}, segment_size: {nullopt}, timestamp_type: {nullopt}, recovery_enabled: {nullopt}, shadow_indexing: {disabled}, read_replica: {nullopt}, read_replica_bucket: {nullopt} remote_topic_properties: {nullopt}, batch_max_bytes: {nullopt}, retention_local_target_bytes: {}, retention_local_target_ms: {}, remote_delete: true, segment_ms: {}, record_key_schema_id_validation: {nullopt}, record_key_schema_id_validation_compat: {nullopt}, record_key_subject_name_strategy:  {nullopt}, record_key_subject_name_strategy_compat: {nullopt}, record_value_schema_id_validation: {nullopt},  record_value_schema_id_validation_compat: {nullopt}, record_value_subject_name_strategy: {nullopt}, record_value_subject_name_strategy_compat: {nullopt}, initial_retention_local_target_bytes: {}, initial_retention_local_target_ms: {}}}, custom_assignments: {}}}
21:32:49,177  INFO || - [DockerizedRedPandaTestSupport] docker-java-stream-785697843 - STDERR: WARN  2024-04-05 21:32:49,176 [shard 0:main] cluster - partition_allocator.cc:234 - Refusing to create 4 new partitions as total partition count 258 would exceed memory limit 256
21:32:49,436  INFO |test_nestedField[useSchemaRegistry=[true]]| - [SqlTestSupport] Time-limited test - Removing 0 cached plans in SqlTestSupport.@After
21:32:49,436  INFO |test_nestedField[useSchemaRegistry=[true]]| - [SimpleTestInClusterSupport] Time-limited test - Ditching 0 jobs in SimpleTestInClusterSupport.@After: []
21:32:49,436  INFO |test_nestedField[useSchemaRegistry=[true]]| - [SimpleTestInClusterSupport] Time-limited test - Destroying 3 distributed objects in SimpleTestInClusterSupport.@After: [hz:impl:mapService/__jet.results, hz:impl:mapService/__jet.records, hz:impl:mapService/__sql.catalog]
21:32:49,437  INFO |test_nestedField[useSchemaRegistry=[true]]| - [HazelcastTestSupport] Time-limited test - Shutting down node factory as @After action
BuildInfo right after test_nestedField[useSchemaRegistry=[true]](com.hazelcast.jet.sql.impl.connector.kafka.SqlAvroTest): BuildInfo{version='5.5.0-SNAPSHOT', build='20240405', buildNumber=20240405, revision=, enterprise=false, serializationVersion=1}
Hiccups measured while running test 'test_nestedField[useSchemaRegistry=[true]](com.hazelcast.jet.sql.impl.connector.kafka.SqlAvroTest):'
21:32:45, accumulated pauses: 3683 ms, max pause: 418 ms, pauses over 1000 ms: 0


No metrics recorded during the test

Standard output can be found here - https://s3.console.aws.amazon.com/s3/buckets/j-artifacts/Hazelcast-master-Redpanda-23.3.z/14/
@olukas olukas added Type: Test-Failure Source: Internal PR or issue was opened by an employee Team: Integration labels Apr 8, 2024
@olukas olukas modified the milestones: 5.5.0, Backlog Apr 8, 2024
@olukas
Copy link
Contributor Author

olukas commented Apr 29, 2024

Failed again on master with oracle-17:

@AleksPeychev
Copy link
Contributor

Failed again on master with oracle-17:

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
Source: Internal PR or issue was opened by an employee Team: Integration Type: Test-Failure
Projects
None yet
Milestone
Backlog
Development

No branches or pull requests
2 participants
@olukas @AleksPeychev