Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add labels to listener volumes [was: Add missing generic labels to all created PersistentVolumeClaims] #555

Open
3 tasks
Tracked by #694
sbernauer opened this issue Mar 25, 2024 · 2 comments

Comments

@sbernauer
Copy link
Member

sbernauer commented Mar 25, 2024

Update: This issue has been rescoped from adding labels to all volumes to just adding labels to the listener volumes. This means the scope has been reduced from refactoring all operators to only refactoring the op-rs and the hdfs operator.

Title

Ensure all listener ephemeral volumes have recommended labels.

Description

Currently there are two different ways to attach listener volumes to hdfs pods:

  • namenodes: use volume claims. These inherit labels from the spec.template of the StatefulSet and are fine.
  • datanodes: uses volumes attached directly to the pod. These do not inherit the labels of the StatefulSet and are the reason of this issue. Because of this, the endpoints are not listed by stackablectl stacket list.

Update: this was the original description. Keeping it for later reference:

We are missing labels on PVCs created by ephemeral volumes (such as datanode listeners). I fear the only way of fixing this is by putting them on the Statefulset spec.template.spec.volumes[_].ephemeral.volumeClaimTemplate.metadata.lables here. PVCs created by StatefulSet spec.volumeClaimTemplates (such as data or persistent listener volumes) seem to be fine.

This was an oversight in #188 (comment)

Value

stackabletctl stacklet list can list both namenodes and datanode endpoints.

Dependencies

none

Tasks

  • The ListenerOperatorVolumeSourceBuilder in operator-rs ensures that recommended labels attached to the ephemeral and persistent volume explicitely.
  • The hdfs operator is updated to new operator-rs version.
  • Every operator that creates listener volumes (currently only hdfs) is checked if it needs to be updated.

Acceptance Criteria

Listener ephemeral and persistent volumes have labels

(Information Security) Risk Assessment

Accessibility Assessment

Quality

Release Notes

No entry

@sbernauer sbernauer changed the title Add generic labels to all created PersistentVolumeClaims Add missing generic labels to all created PersistentVolumeClaims Mar 25, 2024
@razvan razvan assigned razvan and unassigned razvan May 27, 2024
@lfrancke
Copy link
Member

I'd like to see a refinement done on this before starting the work according to our template.

@sbernauer
Copy link
Member Author

done

@razvan razvan changed the title Add missing generic labels to all created PersistentVolumeClaims Add labels to listener volumes [was: Add missing generic labels to all created PersistentVolumeClaims] May 29, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: In Progress
Status: Development: Waiting for Review
Development

No branches or pull requests

4 participants