Fields (multi-fields?) specified in eland.Dataframe columns variable are not always returned

[bartbroere]

I encountered the issue that a field specified in eland.Dataframe's columns parameter ended up as an empty array in the Dataframe (all NaNs), even though it definitely was not empty.

After setting some breakpoints in eland.operations I found a fix that works on our index.
I did not yet reproduce it with the flights or ecommerce sample data yet, but I could work on that later.

[bartbroere]

I think this problem might occur with multi-fields specifically: https://www.elastic.co/guide/en/elasticsearch/reference/current/multi-fields.html

[bartbroere]

I think we could reproduce this issue if we add a copy_to to the testing indices: https://www.elastic.co/guide/en/elasticsearch/reference/current/copy-to.html

I'm trying that now.

[pquentin]

Thanks. Would you mind pasting here a JSON response from Elasticsearch where _source is a list and fields is set?