PHPackages                             dotted-ai/parquet-to-sql - PHPackages - PHPackages  [Skip to content](#main-content)[PHPackages](/)[Directory](/)[Categories](/categories)[Trending](/trending)[Leaderboard](/leaderboard)[Changelog](/changelog)[Analyze](/analyze)[Collections](/collections)[Log in](/login)[Sign up](/register)

1. [Directory](/)
2. /
3. [Database & ORM](/categories/database)
4. /
5. dotted-ai/parquet-to-sql

ActiveLibrary[Database & ORM](/categories/database)

dotted-ai/parquet-to-sql
========================

Laravel helper to import Parquet files into PostgreSQL using COPY for speed.

07PHP

Since Nov 24Pushed 5mo agoCompare

[ Source](https://github.com/dotted-ai/parquet-to-sql)[ Packagist](https://packagist.org/packages/dotted-ai/parquet-to-sql)[ RSS](/packages/dotted-ai-parquet-to-sql/feed)WikiDiscussions main Synced 1mo ago

READMEChangelogDependenciesVersions (1)Used By (0)

Parquet to SQL (Laravel)
========================

[](#parquet-to-sql-laravel)

Helper para importar arquivos Parquet diretamente para tabelas PostgreSQL usando Laravel. Le o arquivo em lotes, tenta usar `COPY` para performance e faz fallback para inserts em massa.

Instalacao
----------

[](#instalacao)

```
composer require dotted-ai/parquet-to-sql
php artisan vendor:publish --tag=config --provider="ParquetToSql\\ParquetToSqlServiceProvider"

```

Dependencias:

- ext-pgsql habilitada no PHP para que o `pgsqlCopyFromArray` funcione.
- `codercat/php-parquet` (ja esta no composer.json) para fazer o parse do arquivo.

Uso rapido (CLI)
----------------

[](#uso-rapido-cli)

```
php artisan parquet:import storage/app/data/users.parquet users \\
  --truncate \\
  --map=id=user_id --map=email=email_address

```

Opcoes principais:

- `--connection=` escolhe a conexao (default: `config('parquet-to-sql.connection')`).
- `--batch=` tamanho do lote (default: `config('parquet-to-sql.batch_size')`).
- `--timeout=` timeout do COPY em segundos.
- `--truncate` roda `TRUNCATE TABLE` antes de inserir.

Uso programatico
----------------

[](#uso-programatico)

```
use ParquetToSql\ParquetImporter;

$importer = app(ParquetImporter::class);

$result = $importer->import(
    path: storage_path('app/data/users.parquet'),
    table: 'users',
    columnMap: ['id' => 'user_id', 'email' => 'email_address'],
    truncateBeforeImport: true,
);

logger()->info('Import', $result->toArray());

```

Enfileirando
------------

[](#enfileirando)

```
use ParquetToSql\ImportParquetJob;

ImportParquetJob::dispatch(
    path: storage_path('app/data/users.parquet'),
    table: 'users',
    columnMap: ['id' => 'user_id'],
    connectionName: 'pgsql',
    truncateBeforeImport: false
);

```

Configuracao
------------

[](#configuracao)

Arquivo `config/parquet-to-sql.php`:

- `connection`: conexao de banco usada pelo importador.
- `batch_size`: quantas linhas sao lidas antes de enviar para o banco.
- `copy_timeout`: timeout do COPY em segundos.

Notas e limites
---------------

[](#notas-e-limites)

- O codigo tenta usar `PDO::pgsqlCopyFromArray`; se nao existir (ex.: SQLite em testes), cai para inserts em lote.
- Nomes de tabela aceitam esquema opcional (`schema.tabela`) usando apenas letras, numeros e `_`. Nomes de colunas/targets do map aceitam apenas letras, numeros e `_` (sem pontos ou espacos) para manter SQL seguro.
- O leitor padrao prioriza APIs de streaming (`readRows`, row groups) para nao carregar o arquivo inteiro em memoria; se a lib expor apenas `read()`, ele ainda funciona, mas pode consumir mais memoria.
- Se sua versao de `codercat/php-parquet` expuser metodos diferentes, implemente um `ParquetRowReader` proprio e passe no importador.

Testes
------

[](#testes)

```
composer install --dev
./vendor/bin/phpunit

```

###  Health Score

18

—

LowBetter than 8% of packages

Maintenance48

Moderate activity, may be stable

Popularity4

Limited adoption so far

Community6

Small or concentrated contributor base

Maturity13

Early-stage or recently created project

 Bus Factor1

Top contributor holds 100% of commits — single point of failure

How is this calculated?**Maintenance (25%)** — Last commit recency, latest release date, and issue-to-star ratio. Uses a 2-year decay window.

**Popularity (30%)** — Total and monthly downloads, GitHub stars, and forks. Logarithmic scaling prevents top-heavy scores.

**Community (15%)** — Contributors, dependents, forks, watchers, and maintainers. Measures real ecosystem engagement.

**Maturity (30%)** — Project age, version count, PHP version support, and release stability.

### Community

Maintainers

![](https://www.gravatar.com/avatar/daf3ae1a09d0082449e5018d6e3ac1db411340b39c38ff9015dfaf3b76b46b8d?d=identicon)[puppe1990](/maintainers/puppe1990)

---

Top Contributors

[![puppe1990](https://avatars.githubusercontent.com/u/8432835?v=4)](https://github.com/puppe1990 "puppe1990 (6 commits)")

### Embed Badge

![Health badge](/badges/dotted-ai-parquet-to-sql/health.svg)

```
[![Health](https://phpackages.com/badges/dotted-ai-parquet-to-sql/health.svg)](https://phpackages.com/packages/dotted-ai-parquet-to-sql)
```

###  Alternatives

[doctrine/orm

Object-Relational-Mapper for PHP

10.2k285.3M6.2k](/packages/doctrine-orm)[jdorn/sql-formatter

a PHP SQL highlighting library

3.9k115.1M102](/packages/jdorn-sql-formatter)[illuminate/database

The Illuminate Database package.

2.8k52.4M9.3k](/packages/illuminate-database)[mongodb/mongodb

MongoDB driver library

1.6k64.0M543](/packages/mongodb-mongodb)[ramsey/uuid-doctrine

Use ramsey/uuid as a Doctrine field type.

90340.3M209](/packages/ramsey-uuid-doctrine)[reliese/laravel

Reliese Components for Laravel Framework code generation.

1.7k3.4M16](/packages/reliese-laravel)

PHPackages © 2026

[Directory](/)[Categories](/categories)[Trending](/trending)[Changelog](/changelog)[Analyze](/analyze)