Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SpikeSortingLoader sl.load_spike_sorting() halts when used in loop #292

Open
mschart opened this issue Mar 10, 2022 · 0 comments
Open

SpikeSortingLoader sl.load_spike_sorting() halts when used in loop #292

mschart opened this issue Mar 10, 2022 · 0 comments
Labels
bug Something isn't working

Comments

@mschart
Copy link
Contributor

mschart commented Mar 10, 2022

Hi guys,
When trying to load spike sorting results for all BWM sessions, the download often halts without progress (can wait very long, say over night). Is there a way to switch off that multi-threading? I suspect that to be related.

    for pid in pids:
        eid, probe = pid
        sl = SpikeSortingLoader(eid=eid, pname=probe, 
                                one=one_online, atlas=ba)
        spikes, clusters, channels = sl.load_spike_sorting()  

It prints this and that doesn't change for many hours, for example. Restarting the download fixes the issue and it quickly downloads as expected. This does not work when having a loop of 350 pids, as then most need to be manually restarted.

Downloading: /mnt/8cfe1683-d974-40f3-a20b-b217cad4722a/FlatIron/zadorlab/Subjects/CSH_ZAD_011/2020-03-23/001/alf/probe01/pykilosort/spikes.amps.9788b83b-ff75-4dbc-8654-ce4fbce36f77.npy Bytes: 119010352
  0%|                                             | 0/119010352 [00:00<?, ?it/s]Downloading: /mnt/8cfe1683-d974-40f3-a20b-b217cad4722a/FlatIron/zadorlab/Subjects/CSH_ZAD_011/2020-03-23/001/alf/probe01/pykilosort/spikes.depths.a47789db-7344-4ce7-885a-4b9f907e202e.npy Bytes: 119010352
150994944it [11:23, 312864.09it/s]                                              
150994944it [11:42, 301432.85it/s]  
@mschart mschart added the bug Something isn't working label Mar 10, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant