Questions about gemini support in the spring ai module

[yangfeng20]

I want to use the gemini apiKey to access my gemini Ai instead of using project-id+location.

Currently, the spring ai module using gemini only supports project-id+location using google cloud.
The apiKey mode in Google ai studio is not supported.

My request was to support the apiKey pattern, similar to openai.

[tzolov]

Hey @yangfeng20 could you provide us with a the Gemini documentation that explains how to create and use api keys?

[yangfeng20]

Ok, please refer to:
https://ai.google.dev/gemini-api/docs/api-overview
https://ai.google.dev/gemini-api/docs/api-key
https://ai.google.dev/gemini-api/docs/get-started/rest

[vanduc2514]

@yangfeng20 There is a way to work around with the current spring-ai-vertex-ai-gemini dependency by replacing the low-level Request Formatter in HttpJsonPredictionServiceStub with the one pointing to the api endpoint of new Gemini AI

ProtoMessageRequestFormatter.<GenerateContentRequest>newBuilder()
                .setPath("/v1beta/models/{model=*}:generateContent", request -> Map.of("model", "gemini-pro"))
                .setQueryParamsExtractor(request -> Map.of("key", List.of("<GEMINI_API_KEY>")))
                .setRequestBodyExtractor(request -> ProtoRestSerializer.create().toBody("*", request.toBuilder().clearModel().build(),false))
                .build()

then set the VertexAI endpoint to https://generativelanguage.googleapis.com and use Transport.REST for VertexAI transport. The above code snippet only works for generateContent endpoint. For other endpoints to work, you will need to replace other request formatters. It's ok for the time being since Google has not provided an offical Java depdency yet.