日本語

CSV Loader

The CSV Loader is a tool for loading CSV files into the DB.

As of v0.8, the CSV Loader will be used for "Flyway Java-based Migration" (specialized for https://flywaydb.org/documentation/concepts/migrations#java-based-migrations).

Required Software

• Java 11+
• Maven / Gradle

Usage (Flyway Java-based Migration)

This section describes how to use the CSV Loader within Flyway java-based Migration. First, configure the project with the Flyway Maven Plugin (with the https://flywaydb.org/documentation/usage/maven/) operational.

• Directory configuration

project
  pom.xml
  src/main
    java
      db/migration
        V2__AddRecords.java
    resources
      db/migration
        V1__CreateTables.sql
        V2__AddRecords
          tabe-list.txt
          TABLE_1.csv
          TABLE_2.csv

Suppose you create a table in V1 _ _ CreateTables. sql and load it from a CSV file in V2 _ _ AddRecords. java.

• V1__CreateTables.sql

CREATE TABLE TABLE_1 (
  COLUMN_1 INT,
  COLUMN_2 VARCHAR(10)
);

:

Next, add the CSV Loader dependency to pom. xml.

• pom.xml

  <dependencies>
    <dependency>
      <groupId>io.sitoolkit.csv</groupId>
      <artifactId>sit-csvloader-core</artifactId>
      <version>0.8</version>
    </dependency>
  </dependences>

Next, create a Migration class to load the data-inherit BaseJavaMigration and run CsvLoader. load in migrate.

• V2__AddRecords.java

package db.migration;

import org.flywaydb.core.api.logging.Log;
import org.flywaydb.core.api.logging.LogFactory;
import org.flywaydb.core.api.migration.BaseJavaMigration;
import org.flywaydb.core.api.migration.Context;

import io.sitoolkit.csv.core.CsvLoader;

@SuppressWarnings("squid:S101")
public class V2__AddRecords extends BaseJavaMigration {

private final Log log = LogFactory.getLog(V2__AddRecords.class);

@Override
public void migrate(Context ctx) throws Exception {
CsvLoader.load(ctx.getConnection(), getClass(), log::info);
}
  
}

The table-list. txt contains the table names of the tables to be loaded in one version, one row at a time, from top to bottom.

• table-list.txt

TABLE_1
TABLE_2

The CSV file contains the column names on the first line and the data to be loaded from the second line.

• TABLE_1.csv

COLUMN_1,COLUMN_2
1,One
2,Two
3,Three

Once this is done, run Flyway Migration with the following command :

mvn flyway:migrate

If the migration is successful, CSV data is loaded into TABLE _ 1.