Skip to content

Added support for parquet files#11655

Closed
ghellings wants to merge 1 commit intofluent:masterfrom
AthosCommerce:add_parquet_support
Closed

Added support for parquet files#11655
ghellings wants to merge 1 commit intofluent:masterfrom
AthosCommerce:add_parquet_support

Conversation

@ghellings
Copy link
Copy Markdown

@ghellings ghellings commented Apr 1, 2026

Adding support for parquet files

Summary by CodeRabbit

  • New Features

    • Fluent Bit now includes Apache Arrow support, enabling seamless processing and integration with Arrow-formatted data streams for enhanced data pipeline compatibility.
  • Chores

    • Updated build system with necessary dependencies and compiler configuration to support Arrow integration.

@coderabbitai
Copy link
Copy Markdown

coderabbitai bot commented Apr 1, 2026

Caution

Review failed

Pull request was closed or merged during review

📝 Walkthrough

Walkthrough

The Dockerfile now installs Apache Arrow development libraries and APT sources in the builder-base stage via Debian package manager, and enables Arrow support in the Fluent Bit CMake build configuration using the -DFLB_ARROW=On flag.

Changes

Cohort / File(s) Summary
Docker Build Configuration
dockerfiles/Dockerfile
Added Apache Arrow APT source installation and dependency packages (libarrow-glib-dev, libparquet-glib-dev). Enabled Arrow support in Fluent Bit build by adding -DFLB_ARROW=On to CMake configuration arguments.

Estimated code review effort

🎯 2 (Simple) | ⏱️ ~10 minutes

Poem

A builder hops along the path so bright,
Arrow libraries shine with newfound light,
With APT sources and CMake so true,
Fluent Bit now soars with Arrow's view! 🐰🔧

🚥 Pre-merge checks | ✅ 3
✅ Passed checks (3 passed)
Check name Status Explanation
Description Check ✅ Passed Check skipped - CodeRabbit’s high-level summary is enabled.
Title check ✅ Passed The title accurately describes the main change: adding Parquet file support to Fluent Bit by installing Arrow libraries and enabling Arrow support in the cmake configuration.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.

✏️ Tip: You can configure your own custom pre-merge checks in the settings.

✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands and usage tips.

@ghellings ghellings closed this Apr 1, 2026
Copy link
Copy Markdown

@chatgpt-codex-connector chatgpt-codex-connector bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 947d329b11

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".


RUN apt-get update \
&& apt-get install -y --no-install-recommends \
lsb-release \
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P1 Badge Fix line continuation in package install command

The backslash on lsb-release \ includes a trailing space, so the shell does not continue this apt-get install line. In Docker build context this splits the command stream and makes the next line execute as bare wget (no URL), which exits non-zero and fails the builder-base image build before Arrow/Parquet dependencies are installed.

Useful? React with 👍 / 👎.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant