Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Getting error while connecting tryng to use Kafka dispatcher #755

Open
B09306 opened this issue Oct 17, 2023 · 1 comment
Open

Getting error while connecting tryng to use Kafka dispatcher #755

B09306 opened this issue Oct 17, 2023 · 1 comment

Comments

@B09306
Copy link

B09306 commented Oct 17, 2023

I am trying to use Kafka dispatcher but getting below error in driver logs. I am using version 1.2.0 with spark 3.3.0

23/10/17 08:46:03 INFO SparkLineageInitializer: Initializing Spline Agent...
23/10/17 08:46:03 INFO SparkLineageInitializer: Spline Version: 1.2.0 (rev. f66d36f)
23/10/17 08:46:03 INFO SparkLineageInitializer: Init Type: AUTO (codeless)
23/10/17 08:46:03 INFO SparkLineageInitializer: Init Mode: ENABLED
23/10/17 08:46:03 ERROR DriverDaemon$: XXX Fatal uncaught exception. Terminating driver.
java.lang.NoClassDefFoundError: org/apache/kafka/clients/producer/Producer

Caused by: java.lang.ClassNotFoundException: org.apache.kafka.clients.producer.Producer

am I missing some configurations?

@cerveada
Copy link
Contributor

add this jar on your classpath:

<dependency>
    <groupId>org.apache.kafka</groupId>
    <artifactId>kafka-clients</artifactId>
    <version>2.4.1</version>
</dependency>

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: New
Development

No branches or pull requests

2 participants