Authentication to Azure Provider

[vwake7]

I am trying to authenticate Azure Provider using
stackql shell --auth="${AUTH}"
Can you provide me a sample of what keys need to be provided in AUTH. I provided Service principal credentials using export variables and got below error

stackql Command Shell 0.5.587
Copyright (c) 2021, stackql studios. All rights reserved.
Welcome to the interactive shell for running stackql commands.
INFO[0000] opened db with file = 'file::memory:?cache=shared' and err  = '<nil>' 
INFO[0000] getNextSessionID(): generation id = 1, session id = 1 
INFO[0000] stylised write called                        

INFO[0000] stylised write called                        
INFO[0000] stylised write called                        
stackql  >>INFO[0015] stylised write called                        
INFO[0015] stylised write called                        
stackql  >>select * from azure.compute.virtualmachines ;INFO[0017] stylised write called                        
INFO[0017] stylised write called                        
stackql  >>select * from azure.compute.virtualmachines ;INFO[0017] stylised write called                        
INFO[0017] stylised write called                        
stackql  >>select * from azure.compute.virtualmachines ;
DEBU[0017] you said: "select * from azure.compute.virtualmachines ;" 
INFO[0017] stylised write called                        
DEBU[0017] PrepareQuery() invoked...                    
DEBU[0017] tcc = &{0xc00070a1d8 1 1 1 1 0xc00070a1d0  []} 
DEBU[0017] node = &{<nil> false false false [] [0xc0007183c0] [0xc000718400] <nil> [] <nil> [] <nil> } 
DEBU[0018] optimistic doc error: Service.GetResource() failure 
DEBU[0018] node = &{<nil> false false false [] [0xc0007183c0] [0xc000718400] <nil> [] <nil> [] <nil> } 
DEBU[0018] canRoute = false, routeType = 2              
DEBU[0018] node = &{<nil> false false false [] [0xc0007183c0] [0xc000718400] <nil> [] <nil> [] <nil> } 
DEBU[0018] canRoute = false, routeType = 2              
INFO[0019] stylised write called                        
Service.GetResource() failure
INFO[0019] stylised write called   

[vwake7]

ok I was able to get authorized to Azure using az login workflow, but how should I get authorized when I programatically invoke pystackql. @jeffreyaven . Any help is appreciated.

[jeffreyaven]

Hey @vwake7 pystackql should inherit the auth on the current system

[vwake7]

@jeffreyaven, Is that the only way to get authorised for batch jobs?

[vwake7]

@jeffreyaven , I meant is there any way I can set the auth through a dictionary or Json, if you can point me to an azure example, it will be helpful. I can't find what keys and values need to be provided in the dictionary.

[jeffreyaven]

Hey @general-kroll-4-life can you help @vwake7

[general-kroll-4-life]

@vwake7 hiya and thanks for driving this. We do actually support this, please check out https://github.com/stackql/stackql/blob/main/docs/auth.md#azure-auth

If you want full automation, these are starting points:

• https://github.com/stackql/stackql/blob/main/docs/auth.md#azure-auth
• https://learn.microsoft.com/en-us/azure/developer/go/azure-sdk-authentication-service-principal?tabs=azure-cli

[vwake7]

Thanks, will check and get back

[general-kroll-4-life]

@vwake7 cheers, please reach out if you are stuck. We want to make sure it works for you

[vwake7]

@general-kroll-4-life , I am getting Service.GetResource() failure error, Is this an auth error?

root@4ef7e6e8a0df:/opt/stackql# export AZURE_TENANT_ID="1"
export AZURE_CLIENT_ID="2
export AZURE_CLIENT_SECRET="3"
export AZURE_SUBSCRIPTION_ID="4"
root@4ef7e6e8a0df:/opt/stackql# stackql shell --auth="{ "azure": { "type": "azure_default" }}" --loglevel=debug
INFO[0000] stylised write called                        

INFO[0000] stylised write called                        
stackql Command Shell 0.5.587
Copyright (c) 2021, stackql studios. All rights reserved.
Welcome to the interactive shell for running stackql commands.
---
INFO[0000] opened db with file = 'file::memory:?cache=shared' and err  = '<nil>' 
INFO[0000] getNextSessionID(): generation id = 1, session id = 1 
INFO[0000] stylised write called                        

INFO[0000] stylised write called                        
INFO[0000] stylised write called                        
stackql  >>INFO[0010] stylised write called                        
INFO[0010] stylised write called                        
stackql  >>select * from azure.compute.virtualmachines ;INFO[0012] stylised write called                        
INFO[0012] stylised write called                        
stackql  >>select * from azure.compute.virtualmachines ;INFO[0012] stylised write called                        
INFO[0012] stylised write called                        
stackql  >>select * from azure.compute.virtualmachines ;
DEBU[0012] you said: "select * from azure.compute.virtualmachines ;" 
INFO[0012] stylised write called                        
DEBU[0012] PrepareQuery() invoked...                    
DEBU[0012] tcc = &{0xc0003b8348 1 1 1 1 0xc0003b8340  []} 
DEBU[0012] node = &{<nil> false false false [] [0xc000500400] [0xc000500440] <nil> [] <nil> [] <nil> } 
DEBU[0013] optimistic doc error: Service.GetResource() failure 
DEBU[0013] node = &{<nil> false false false [] [0xc000500400] [0xc000500440] <nil> [] <nil> [] <nil> } 
DEBU[0013] canRoute = false, routeType = 2              
DEBU[0013] node = &{<nil> false false false [] [0xc000500400] [0xc000500440] <nil> [] <nil> [] <nil> } 
DEBU[0013] canRoute = false, routeType = 2              
INFO[0014] stylised write called                        
Service.GetResource() failure
INFO[0014] stylised write called  

[jeffreyaven]

I think you may be missing an underscore @vwake7 virtual_machines