Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Dask Demo Day - Sign up issue #307

Open
ncclementi opened this issue Feb 16, 2023 · 64 comments
Open

Dask Demo Day - Sign up issue #307

ncclementi opened this issue Feb 16, 2023 · 64 comments

Comments

@ncclementi
Copy link
Member

ncclementi commented Feb 16, 2023 •
edited by scharlottej13

Next Demo Day: June 6th

See what the Dask community has been up to, or share some Dask work of your own. Demos are short and informal (~5-10 minutes). Have something you'd like to share? Leave a comment and let us know.

Meetings are held on the first Thursday of each month at 11am US Eastern on Zoom.
Zoom link: https://us06web.zoom.us/j/87619866741?pwd=S2RxMlRKcnVvakt4NHZoS1cwOGZoZz09

Subscribe to the Dask event calendar to be notified of changes:

Past Demo Days

Meetings are recorded and shared on the Dask YouTube channel.
@ncclementi
Copy link
Member Author

  • @brian-methodical Can we get some folks from your team to sign up for one of the upcoming dates?

  • @mgrover1 Do you think the 03/16 date would work for you? Do you want to drop a comment with a proposed date and title?

  • @TomNicholas Whenever you can drop a comment on what date would be more convenient for you, that would be great.

  • @raybellwaves @jorisvandenbossche @tastatham @martinfleis Can we get a demo (or two) that involves dask-geopandas? Or can you volunteer someone :) ?

@martinfleis
Copy link

@ncclementi I could do a short demo of dask-geopandas in May but happy to leave the place to others if they're interested.

@ncclementi
Copy link
Member Author

@martinfleis I'll take you up for May, if you know of folks that would like to show their applications on any of the dates, please send them this issue. It'll be great to hear more about how dask-geopandas is being used.

@TomNicholas
Copy link

I think 16th March is good for me!

@ncclementi
Copy link
Member Author

@TomNicholas Thanks Tom 🙌 , do you have a title that would summarize your demo? If not yet, we can set it later

@TomNicholas
Copy link

Something like "Analysing Terabytes of Ocean Simulation model output with Xarray, xgcm and xhistogram"

@dchudz
Copy link

dchudz commented Feb 28, 2023

@ncclementi I'd like to demo Coiled's "package sync" feature (should be interesting even for folks not planning to use Coiled).

@mgrover1
Copy link

mgrover1 commented Mar 1, 2023

Yes to 3/16! Still trying to come up with a title, but it will be related to scaling weather radar data analysis with dask!

@ncclementi
Copy link
Member Author

Thanks @mgrover1 and @dchudz We'll have you on the list! 🎉

@ncclementi ncclementi mentioned this issue Mar 6, 2023
Closed
@astrojuanlu astrojuanlu mentioned this issue Mar 10, 2023
Open
@ncclementi
Copy link
Member Author

@martindurant and @douglasdavis would you be interested in presenting at the April upcoming session?

@lgray
Copy link

lgray commented Mar 31, 2023 •
edited

Hi @ncclementi - I'm using dask-awkward and dask-histogram for high energy physics analysis and can give some real-world examples of how we'd use @martindurant and @douglasdavis's work. I think I can fit that all into 10 minutes. I'm available for April 20th.

@ncclementi
Copy link
Member Author

@lgray That would be awesome! We usually do 5-7 min but since we do not have folks for April yet, I think 10 min will work, plus you will be showcasing two dask projects!
I'll write you down for April 20th then!!

@AmineDiro
Copy link

Hello @ncclementi , I built daskqueue, a lightweight Distributed Task Queue library built on top of Dask. Daskqueue also implements persistent queues for holding tasks on disk and surviving Dask cluster restart. I would love to present this library according to the format of your choosing and April 20th sounds excellent for me.

The title of the talk would be daskqueue : a dask-based distributed task queue.

@brian-methodical
Copy link

brian-methodical commented Apr 4, 2023 via email •
edited

@ncclementi
Copy link
Member Author

@AmineDiro Thank you, that sounds awesome. I'll set you on the list for April 20th, regarding the format.

These are 5-7 minute demos that show off ongoing or lesser-known work. We hope to have 3-5 of these during the meeting. Meetings will be recorded and advertised on social. Hopefully, this helps to educate folks on some of the great work people are up to.

I just updated this issue with a link to the meeting for clarity. I will eventually create an April issue specific.

@brian-methodical
Copy link

brian-methodical commented Apr 6, 2023 •
edited

We can take May Demo, I’ll bring Dan from my MLOps team to this weeks meeting to intro and get involved

RE https://github.com/dandawg

@ncclementi
Copy link
Member Author

@danwang if you can drop a title for your may demo that would be great.

@dandawg
Copy link

dandawg commented Apr 6, 2023

@danwang if you can drop a title for your may demo that would be great.

Thanks @ncclementi . I don't have a title yet--I need to narrow my topic area a little more. I'll commit to having one though by next week.

@jacobtomlinson
Copy link
Member

@ncclementi if you're still looking for another demo for the April Demo Day I'd love to do a quick demo of launching a Jupyter/Dask cluster on NVIDIA Base Command Platform which comes with all the GPU stuff configured.

@ncclementi
Copy link
Member Author

@jacobtomlinson That would be great! I'll add you to the list.

@ncclementi ncclementi mentioned this issue Apr 11, 2023
Closed
@mrocklin mrocklin pinned this issue Apr 27, 2023
@mrocklin
Copy link
Member

I'm talking to @fab_clemente here from https://github.com/ydataai/ydata-profiling , a dataframe profiling library (gives summary statistics and more like https://ydata-profiling.ydata.ai/examples/master/census/census_report.html) that works well with Pandas and Spark. It might be an interesting demo to try to see if there is interest in a Dask integration.

@ncclementi what do you think?

@ncclementi
Copy link
Member Author

@fabclmnt would you be up for demoing according to the format described above on May 18th 11am EDT?

@mrocklin
Copy link
Member

mrocklin commented May 3, 2023

@rjzamora want to give a demo on dask-expr?

@dandawg
Copy link

dandawg commented May 3, 2023

I owe an update here. My topic is still in dev, and needs some more exploring. Client work has gotten in the way a bit. I'll attend the community meeting tomorrow, and I can give an update on what I'm thinking about, and maybe get some feedback.

@ncclementi
Copy link
Member Author

@martinfleis Are you still on for the May Dask Demo Day? Do you have a title/topic?

@martinfleis
Copy link

@ncclementi I apparently messed up time zones (again!) and am supposed to speak at another event at the same time. @jorisvandenbossche @jsignell any chance you'd be willing to take over? If not we may need to reschedule for another month. Sorry for complications!

@ncclementi ncclementi mentioned this issue Jun 8, 2023
Closed
@Matt711
Copy link
Member

Matt711 commented Jul 6, 2023

I'd like to do a demo of the Dask Operator. Maybe talk about what's new since @jacobtomlinson 's demo

@GueroudjiAmal
Copy link

I would like to do a demo of introducing external tasks in Dask distributed on July 20th or the next date.

@ncclementi
Copy link
Member Author

@davemlz I have you for a demo on July 20th. Do you have a title or topic?

@davemlz
Copy link

davemlz commented Jul 8, 2023

@ncclementi, I'll have to cancel my talk. I apologise for any inconvenience.

@skrawcz
Copy link

skrawcz commented Jul 18, 2023

Thanks for chatting with me @ncclementi, I'd like to confirm that I should be able to give a quick demo of the (naive) integration Hamilton has with Dask to get thoughts and reactions.

@ncclementi
Copy link
Member Author

@skrawcz Awesome, I'll add you to the list!

@ncclementi ncclementi mentioned this issue Jul 18, 2023
Closed
@GueroudjiAmal GueroudjiAmal mentioned this issue Aug 3, 2023
Open
@jrbourbeau jrbourbeau mentioned this issue Aug 15, 2023
Closed
@fjetter
Copy link
Member

fjetter commented Sep 7, 2023

Next session I can talk about

Performance with P2P array rechunking

  • Status quo of the two available methods tasks vs p2p
  • Discuss how we look at performance, what kind of metrics we are interested in and what kind of performance we expect theoretically
  • Depending on time, shed light on some already known problems

@scharlottej13 scharlottej13 mentioned this issue Sep 12, 2023
Closed
@scharlottej13
Copy link
Collaborator

@mrchtr I have you down for the Oct. 19th demo day, thanks! Excited to learn more about fondant

@jhamman
Copy link
Member

jhamman commented Sep 21, 2023

If there's room, I'd be up for sharing a Dask <> Arraylake integration demo on Oct. 19th.

@mrocklin
Copy link
Member

mrocklin commented Sep 21, 2023 via email

@jrbourbeau
Copy link
Member

Sounds great, thanks @jhamman

@jrbourbeau jrbourbeau mentioned this issue Oct 11, 2023
Closed
@cisaacstern
Copy link

Is this still the place to sign up for demo day?

If so, and assuming there's space in the schedule for 12/21, I'd love to present a status update on the Apache Beam DaskRunner (possibly with assistance of @jacobtomlinson, assuming he'll be in attendance).

@mrocklin
Copy link
Member

mrocklin commented Dec 18, 2023 via email

@cisaacstern
Copy link

Absolutely. Based on https://docs.dask.org/en/stable/support.html#discussion, looks like the next one will be Jan 18?

@scharlottej13 scharlottej13 mentioned this issue Mar 19, 2024
Closed
@scharlottej13
Copy link
Collaborator

@ahuang11 is up for presenting on streamjoy for the next demo day on April 18th 🎉. Streamjoy turns images into animations and uses Dask for parallel image processing.

@jrbourbeau jrbourbeau mentioned this issue Apr 17, 2024
Closed
@v2thegreat
Copy link

Hi!

If spots are still available, I'd like to demo Hvplot on May 16th. I'll be showing some examples of its use with Xarray, Pandas, and, of course, Dask.

It's a great, underutilized Python library that I've come to love after using it almost daily over the past few years.

@jacobtomlinson
Copy link
Member

@v2thegreat the next community meeting will be on June 6th at 10am US Central. Are you up for doing a demo then?

@v2thegreat
Copy link

That sounds good to me!

@jacobtomlinson
Copy link
Member

Ok great I've added you to the agenda

@scharlottej13
Copy link
Collaborator

the next community meeting will be on June 6th at 10am US Central.

@ahuang11 would you also be up for doing a demo on streamjoy at the next community meeting? (I think you ended up not presenting in April because not enough people signed up)

@ahuang11
Copy link

Yes that works for me!

@scharlottej13
Copy link
Collaborator

Great! I've added you to the agenda as well.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests