extending a postProcessing filter

[wajda]

Hello, I am trying to use a postProcessing filter:

but I am getting this error:
Make sure that type NamedEntity is in your classpath and check for conflicting dependencies with -Ylog-classpath.
A full rebuild may help if 'LineageDispatcher.class' was compiled against an incompatible version of za.co.absa.commons.

I am using this version: spark-3.3-spline-agent-bundle_2.12. and spark 3.3.1
It was working before version 1.0. thanks a lot

Originally posted by @kuhnen in #713 (comment)

[wajda]

I'm not exactly sure what is happening. It might be caused by some mess in the classpath, but not 100% sure without having a deep look. Try to extend the AbstractPostProcessingFilter abstract class instead of PostProcessingFilter trait. Make sure you don't mixup old and new spine versions etc. Try a clean build of your project.

[kuhnen]

@wajda any class coming from commons is not visible when trying to compile with sbt. Already tried clean and rebuild. I also compiled the spline agent at my machine add the jar to lib/ and did not work :(

[kuhnen]

@wajda I believe it is related with this =>

[kuhnen]

just tested with 1.2.0. then it works. I believe the issue is with the Shading

[wajda]

I see now. Yes, you are right. The NamedEntity trait accidentally appeared to be in the same package as the stuff from absa-commons library, and it happened to also be a part of the agent public API, hence the error. Will fix it asap.

[wajda]

Created a new issue #723. Closing this discussion.