Skip to content

Document and add regression tests for safeColumns in ParquetReadOptions #189

@Anamika1608

Description

@Anamika1608

ParquetReadOptions currently exposes a safeColumns :: Bool option in the Parquet reader API, but it does not seem to be covered in the user-facing
Parquet documentation or the Parquet test suite.

Current state in main:

  • safeColumns is part of ParquetReadOptions
  • it is implemented in the Parquet read path
  • but the cookbook section for Parquet options only documents:
    • selectedColumns
    • predicate
    • rowRange
  • I also could not find a regression test specifically covering safeColumns

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions