Batch NullPointerException despite using updated join.jar

[Mitch Gibbs]

I'm using FRIL 2.1.5 with the updated join.jar and I have a linking job that works fine interactively but fails with a NullPointerException when I run it as a batch job.

The command I'm issuing is:

$JAVA_CMD -Xmx1536M -cp jars/janino.jar:jars/rsyntaxtextarea.jar:jars/libsvm.jar:jars/xercesImpl.jar:jars/xml-apis.jar:jars/join.jar:jars/emory-util-all.jar:jars/opencsv-2.0.jar:jars/poi-3.1-FINAL-20080629.jar:jars/poi-contrib-3.1-FINAL-20080629.jar:poi-scratchpad-3.1-FINAL-20080629.jar:jdbc/* -Dconfig=/home/gpadmin/gpWorkspace/frilConfig/gpMatchCoreActivevSecondaryActive2.xml cdc.impl.Main

The error is:

Exception in thread "main" cdc.utils.RJException: Exception occured.
    at cdc.impl.join.snm.JoiningThread.run(JoiningThread.java:141)
Caused by: java.lang.NullPointerException
    at cdc.impl.join.common.DataSourceNotJoinedJoinListener.createSaverIfNeeded(DataSourceNotJoinedJoinListener.java:73)
    at cdc.impl.join.common.DataSourceNotJoinedJoinListener.trashingNotJoinedTuple(DataSourceNotJoinedJoinListener.java:92)
    at cdc.components.AbstractJoin.notifyTrashingNotJoined(AbstractJoin.java:271)
    at cdc.impl.join.snm.SNMJoin_v1$SNMJoinConnector.notifyTrashingNotJoined(SNMJoin_v1.java:102)
    at cdc.impl.join.snm.JoiningThread.dispose(JoiningThread.java:416)
    at cdc.impl.join.snm.JoiningThread.linkData(JoiningThread.java:300)
    at cdc.impl.join.snm.JoiningThread.run(JoiningThread.java:131)

I can post the configuration file and output if needed but didn't want to overwhelm the thread.

Any advice?

Thanks!

Mitch

[Mitch Gibbs]

I forgot to mention, I'm on Linux.

[Pawel Jurczyk]

Thanks Mitch, we will take a look at the exception.

[Mitch Gibbs]

Thanks very much. Let me know if I can provide any further information that might help.

[Mitch Gibbs]

Pawel - Have you had an opportunity to take a look at this? I'm easily stumped when trying to figure out why java doesn't work, which just means I'm still stumped :-(

I love FRIl, just a stupendously useful project. Thanks for all of your efforts.

Mitch

[Mitch Gibbs]

An update: I replaced join.jar with the updated version from 2011 again (I know I've done it a couple of times already, plus I'm running 2.1.5) and it is now able to get through the processing. I have no idea what has changed.

I am still getting an NPE, but it occurs after the results have been written to a file, which is less of a concern - though it's still a concern since I'm triggering FRIL from Talend, which uses Java.

Exception in thread "main" java.lang.NullPointerException
    at cdc.impl.Main.runJoin(Main.java:113)
    at cdc.impl.Main.main(Main.java:103)

[Patrick McIntyre]

Just curious if anybody has made any progress on this or even if this project is still active?

I replaced the join.jar also and I am still getting the same error. I am using this in deduplication mode, not record linkage mode.

Let me know if I can provide any info. Thanks in advance!
Patrick