Package dev.vortex.jni

Class NativeDataSource

java.lang.Object
dev.vortex.jni.NativeDataSource
public final class NativeDataSource extends Object
JNI boundary for DataSource.

  • Method Summary

    Modifier and Type
    Method
    Description
    static void
    arrowSchema(long sessionPointer, long pointer, long schemaAddress)
    Export the data source's schema into the Arrow C Data Interface struct at schemaAddress.
    static void
    byteSize(long pointer, long[] out)
    Populate out with [bytes, precision], the sum of on-storage file sizes for the data source.
    static void
    free(long pointer)
    Free a data source pointer.
    static long
    open(long sessionPointer, String[] uris, Map<String,String> options)
    Open a data source from one or more URIs or globs.
    static long
    openFiles(long sessionPointer, Object[] readables, String[] names, long[] lengths, int readConcurrency)
    Open a data source over caller-provided NativeReadable objects.
    static void
    rowCount(long pointer, long[] out)
    Populate out with [rows, cardinality].

    Methods inherited from class java.lang.Object

    clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

  • Method Details

    • open

      public static long open(long sessionPointer, String[] uris, Map<String,String> options)
      Open a data source from one or more URIs or globs.
      Parameters:
      sessionPointer - pointer from NativeSession.newSession()
      uris - paths or globs (for example ["file:///a.vortex", "file:///b.vortex"])
      options - object-store properties (may be null)

    • openFiles

      public static long openFiles(long sessionPointer, Object[] readables, String[] names, long[] lengths, int readConcurrency)
      Open a data source over caller-provided NativeReadable objects. All reads become upcalls into the supplied readables; no native storage client is created.
      Parameters:
      sessionPointer - pointer from NativeSession.newSession()
      readables - one NativeReadable per file
      names - unique name per file (from NativeReadable.name()), parallel to readables
      lengths - file sizes in bytes, parallel to readables
      readConcurrency - maximum in-flight readFully upcalls across all files of this data source; <= 0 selects the default

    • free

      public static void free(long pointer)
      Free a data source pointer.

    • arrowSchema

      public static void arrowSchema(long sessionPointer, long pointer, long schemaAddress)
      Export the data source's schema into the Arrow C Data Interface struct at schemaAddress. Extension dtypes are dispatched through the session's registered Arrow export plugins.
      Parameters:
      sessionPointer - pointer from NativeSession.newSession()

    • rowCount

      public static void rowCount(long pointer, long[] out)
      Populate out with [rows, cardinality]. Cardinality is one of 0=unknown, 1=estimate, 2=exact.

    • byteSize

      public static void byteSize(long pointer, long[] out)
      Populate out with [bytes, precision], the sum of on-storage file sizes for the data source. Precision is one of 0=unknown, 1=estimate, 2=exact.