How to save a 3D Mesh OBJ model into weaviate

[coyzeng]

How to save a 3D Mesh OBJ model into weaviate

[JoanFM]

how do you describe your 3D model object in terms of BaseDoc?

[coyzeng]

Like this，I want to save obj model vector to Weaviate for search.

@spi('three2vec')
class Three2VecTransformer(Transformer):

    def __init__(self):
        db = WeaviateDocumentIndex.DBConfig()
        db.host = 'http://localhost:6543/weaviate'
        # db.index_name = 'three2vec'
        self.db = WeaviateDocumentIndex[Mesh3D](db_config=db)

    def transform(self, kind: str, buff: bytes) -> bytes:
        src = tempfile.mkstemp(f".{kind}", tool.new_trace_id())[1]
        dst = tempfile.mkstemp('.obj', tool.new_trace_id())[1]
        try:
            with (open(file=src, mode='wb+') as fs):
                fs.write(buff)
                # model = o3d.io.read_triangle_mesh(src)
                # # model.compute_vertex_normals()
                # voxel_grid = o3d.geometry.VoxelGrid().create_from_triangle_mesh(input=model, voxel_size=5)
                # o3d.io.write_voxel_grid(dst, voxel_grid)
                # o3d.visualization.draw_geometries([voxel_grid])

                # model = model.subdivide_loop(number_of_iterations=1)
                # o3d.visualization.draw_geometries([model], mesh_show_wireframe=True)

                # model.compute_vertex_normals()
                # point_cloud = model.sample_points_uniformly(number_of_points=20000)
                # o3d.visualization.draw_geometries([point_cloud])
                #
                mesh = Mesh3D(url=src)
                mesh.tensors = mesh.url.load()
                mesh.embedding = mesh.tensors.vertices
                mesh.url.display()
                self.db.index(mesh)

                r, s = self.db.find(mesh, limit=10)

                codec = ServiceLoader.load(Codec).get_default()
                return codec.encode({})

            # with open(file=dst, mode='rb+') as fs:
            #     return fs.read()
        finally:
            os.remove(src)
            os.remove(dst)

[JoanFM]

how is this Mesh3D object described. YOu need to describe what is the embedding field on ur data.

See here how it describes that embedding is the embedding field and that will be understood by the DocumentIndex to know which field to use to index.

[coyzeng]

Thanks, but I only want to find a api to embedding Mesh to vector. docarray can provide any function to embedding(mesh.tensors.vertices) to vector directly.