Optimizing dictionary data structures fails when using a partially initialized function

[enrico-stauss]

When passing fn=partial(my_func, arg1=arg1) to optimize, the line linked below will yield only the keys of the dictionary that my_funcreturns. I avoided the issue by not using partial for my usecase but I`d consider this a bug.

Kind regards :)

litdata/src/litdata/processing/functions.py

Line 138 in a09de86

if isinstance(self._fn, partial):

[github-actions]

Hi! thanks for your contribution!, great first issue!

[tchaton]

Hey @enrico-stauss, Could you try out the latest version of litdata ?