cannot connect

[RonOrgad]

i am trying insert a new table to PG data base and still getting " No suitable driver "

      def save_to_postgres(table) -> None : 

           spark = SparkSession.builder.appName("SaveToPG").config("spark.driver.extraClassPath", 
           "/Users/ronorgad/Desktop/testing pyspark/postgresql-42.6.0.jar").getOrCreate()

          url = "jdbc:postgresql://localhost:5432/flight_db"

         table.write.format("jdbc").option("url",url).option("driver","org.postgresql.Driver")
        .option("dbtable",db_table)
        .option("user",username)
        .option("password",password).save()

[davecramer]

You can try calling class.forName("org.postgresql.Driver") spark may not automatically load it

[RonOrgad]

i am just trying to insert a spark dataframe to my pg table using this function:
def save_to_postgres(table) -> None :

       spark = SparkSession.builder.appName("SaveToPG").config("spark.driver.extraClassPath", 
       "/Users/ronorgad/Desktop/testing pyspark/postgresql-42.6.0.jar").getOrCreate()

      url = "jdbc:postgresql://localhost:5432/flight_db"

     table.write.format("jdbc").option("url",url).option("driver","org.postgresql.Driver")
    .option("dbtable",db_table)
    .option("user",username)
    .option("password",password).save()

and it just not working

maybe do you have a python function that can do it ?
thanks

[davecramer]

@sehrope good catch

[RonOrgad]

your are right i have just re write it
spark = SparkSession.builder.appName("SaveToPG").config("spark.driver.extraClassPath",
"/Users/ronorgad/Desktop/testing_pyspark/postgreql-42.6.0.jar").getOrCreate()

still "No suitable driver"

[sehrope]

I think you have a missing "s" in "postgre__S__ql" in: "/Users/ronorgad/Desktop/testing_pyspark/postgreql-42.6.0.jar"

Whatever path you have there, copy it from your code and make sure you can run from a terminal: ls -l "/Users/ronorgad/Desktop/testing_pyspark/postgreql-42.6.0.jar"

If that does not work, a spark related forum would be more appropriate for this type of question as it's not an issue with the driver. This is a spark configuration issue.