Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

LFX: Research querying Apache Parquet files #167

Open
fpetkovski opened this issue Jan 31, 2023 · 12 comments
Open

LFX: Research querying Apache Parquet files #167

fpetkovski opened this issue Jan 31, 2023 · 12 comments

Comments

@fpetkovski
Copy link
Collaborator

Since we have a separation between the logical plan and execution, we can allow querying arbitrary data sources using PromQL.

One such data source could be Apache Parquet files, similar to how https://github.com/polarsignals/frostdb currently works.
We can also investigate options to directly integrate with FrostDB if that makes querying Parquet simpler.

@Shubham4359
Copy link

Hey @fpetkovski I would like to work on this issue in the upcoming LFX mentorship term. I have previously worked with Apache Parquet files where i had to write given metadata to parquet files. Doing query on top of Parquet files would be the next stage of exploration for me. Can you give me a brief idea about the prerequisites needed to learn and is there anything else that needs to be looked into?

@fpetkovski
Copy link
Collaborator Author

Hey @Shubham4359, thanks for expressing interest in this project. Feel free to apply through the LFX website :)

@Althaf66
Copy link

Althaf66 commented Feb 7, 2023

I am interest in this project.Can you give the information about the project breifly and its prerequesites.

@fpetkovski
Copy link
Collaborator Author

fpetkovski commented Feb 7, 2023

@Althaf66
Copy link

Althaf66 commented Feb 7, 2023

Hi @fpetkovski ,Thanks for the information.I like to work on this issue in the LFX mentorship term. I requested to give prerequisites and tools or techstack to complete this project.

@fpetkovski
Copy link
Collaborator Author

Hi @Althaf66, knowledge of golang should be sufficient for this project.

@vishalvivekm
Copy link

Hi @fpetkovski
I am a beginner learning go.
I am really interested to contribute to this project as a Linux Foundation mentee for the upcoming spring term.
After applying, I was curious if I should focus solely on finding and contributing to issue or I should focus on learning about the go and project-requisites in more detail ?
can you please help me on this!

@fpetkovski
Copy link
Collaborator Author

Hi @vishalvivekm, feel free to look at the issues with a good-first-issue tag :)

@Sagar180304
Copy link

Hi @fpetkovski I am looking forward to contribute in these issue under LFX Mentorship 2023

@vishalvivekm
Copy link

Hi @vishalvivekm, feel free to look at the issues with a good-first-issue tag :)

Roger That. I'll be looking for them to make contributions.
Thanks :)

@Zaher1307
Copy link

Hi @fpetkovski, I will be glad to work in this issue in LFX mentorship. I have previous work experience in Golang and I have already applied in LFX website, so what should I have to do to contribute?

@douglascamata
Copy link

There has been an LFX mentee selected to work on this: @Shubham4359, as communicated through the #thanos-dev CNCF channel.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

7 participants