Skip to content

Flink Iceberg should support Flink's IOs in addition to Iceberg's IO #15352

Description

@mxm

Feature Request / Improvement

Flink already has a so called FileSystem implementation for S3, HDFS, and others. Iceberg ships its own implementation via FileIO. In many scenarios, Flink's file system is already setup correctly, but still the user has to go through hoops to setup Iceberg's FileIO.

Flink Iceberg should get a wrapper which discovers Flink's FileSystem and defers calls to it.

Query engine

Flink

Willingness to contribute

  • I can contribute this improvement/feature independently
  • I would be willing to contribute this improvement/feature with guidance from the Iceberg community
  • I cannot contribute this improvement/feature at this time

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    improvementPR that improves existing functionality

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions