Java写入ClickHouse

文章介绍了如何在Java项目中添加ClickhouseJDBC依赖,创建实体类,并实现数据插入功能。通过BalancedClickhouseDataSource建立连接,预编译SQL语句,将对象数据批量插入到Clickhouse的person表中。

摘要生成于 C知道 ,由 DeepSeek-R1 满血版支持, 前往体验 >

一、添加依赖

在pom.xml 增加clickhouse 客户端依赖

<dependency>
    <groupId>ru.yandex.clickhouse</groupId>
    <artifactId>clickhouse-jdbc</artifactId>
    <version>0.2.4</version>
</dependency>

二、sink实现

1、实体类

package bean;

public class Person {
    public int id;
    public String name;
    public int age;

    public Person(int id, String name, int age) {
        this.id = id;
        this.name = name;
        this.age = age;
    }
}

2、sink代码

import bean.Person;
import ru.yandex.clickhouse.BalancedClickhouseDataSource;
import ru.yandex.clickhouse.ClickHouseConnection;
import ru.yandex.clickhouse.settings.ClickHouseProperties;

import java.lang.reflect.Field;
import java.sql.PreparedStatement;
import java.sql.SQLException;

public class ClickHouseSink{

    private static final ClickHouseProperties properties = new ClickHouseProperties();
    private static BalancedClickhouseDataSource ds;
    private static ClickHouseConnection connection;
    private static PreparedStatement ps;
    //插入语句
    private static final String SQL = "insert into test.person(id,name,age) values(?,?,?)";

    /**
     * 初始化配置
     */
    private static void initialize() {
        try {
            properties.setUser("distributed-write");
            properties.setPassword("CloudMinds#");
            ds = new BalancedClickhouseDataSource("jdbc:clickhouse://172.16.32.96:9090/ceph_meta", properties);
            connection = ds.getConnection();
        } catch (Exception e) {
            e.printStackTrace();
        }
    }

    /**
     * 关闭连接
     */
    private static void close() {
        if (ps != null) {
            try {
                ps.close();
            } catch (SQLException e) {
                e.printStackTrace();
            }
        }
        if (connection != null) {
            try {
                connection.close();
            } catch (SQLException e) {
                e.printStackTrace();
            }
        }
    }

    public static void main(String[] args) {
        initialize();
        Person person = new Person(10,"王五",15);
        insertData(SQL,person);
    }

    /**
     * 插入数据到clickhouse
     */
    public static <T> void insertData(String sql,T line ) {
        try {
            ps = connection.prepareStatement(sql);
            Field[] fields = line.getClass().getDeclaredFields();
            for (int i = 0; i < fields.length; i++) {
                Field field = fields[i];
                try {
                    Object o = field.get(line);
                    ps.setObject(i + 1, o);
                } catch (IllegalAccessException e) {
                    e.printStackTrace();
                }
            }
            ps.addBatch();
            ps.executeBatch();
            ps.clearBatch();
            close();
            connection.close();
        } catch (SQLException e) {
            e.printStackTrace();
        }
    }
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值