How to use .ndjson files directly from adresse.data.gouv.fr instead of downloading the full bundle?

[Loocist23]

Hi there,

I'm working on a project where I need to use the BAN (Base Adresse Nationale) data provided by adresse.data.gouv.fr. Currently, I'm downloading the .ndjson.gz file for the Gard department (department 30) each time I start my Docker container.

Context:

• The .ndjson.gz file is around 30MB, which is manageable.
• However, the full bundle (the complete .zip file) is around 2GB and takes about 15 minutes to download each time, which is impractical for my use case.
• I'm working with Nîmes Métropole and trying to host the BAN data locally to avoid being blocked due to excessive requests.

Question:

• Is there a way to use the .ndjson files directly without having to download the full bundle each time?
• Can I host the .ndjson files locally and point my application to this local source?
• Are there any best practices or tools for efficiently managing and updating the .ndjson files locally?

Additional Information:

• I'm using Docker and a Python/Node.js environment.
• I'm currently using addok to process the data and create a searchable database.

Thank you for your help!