Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-25547

Pluggable jdbc connection factory

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • 2.3.1
    • None
    • SQL
    • None

    Description

      The ability to provide a custom connectionFactoryProvider via JDBCOptions so that JdbcUtils.createConnectionFactory can produce a custom connection factory would be very useful. In our case we needed to have the ability to load balance connections to an AWS Aurora Postgres cluster by round-robining through the endpoints of the read replicas since their own loan balancing was insufficient. We got away with it by copying most of the spark jdbc package and provide this feature there and changing the format from jdbc to our new package. However it would be nice  if this were supported out of the box via a new option in JDBCOptions providing the classname for a ConnectionFactoryProvider. I'm creating this Jira in order to submit a PR which I have ready to go.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              fsauer65 Frank Sauer
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: