flink Too many fields referenced from an atomic type
flink Too many fields referenced from an atomic type
- 这个问题 来源于 你的pojo,基本类没有 无参构造器
- 代码
这个问题 来源于 你的pojo,基本类没有 无参构造器
Exception in thread “main” org.apache.flink.table.api.ValidationException: Too many fields referenced from an atomic type.
at org.apache.flink.table.typeutils.FieldInfoUtils.extractFieldInfoFromAtomicType(FieldInfoUtils.java:388)
at org.apache.flink.table.typeutils.FieldInfoUtils.extractFieldInformation(FieldInfoUtils.java:259)
at org.apache.flink.table.typeutils.FieldInfoUtils.getFieldsInfo(FieldInfoUtils.java:227)
at org.apache.flink.table.api.internal.BatchTableEnvImpl.asQueryOperation(BatchTableEnvImpl.scala:238)
at org.apache.flink.table.api.java.internal.BatchTableEnvironmentImpl.fromDataSet(BatchTableEnvironmentImpl.scala:61)
at org.apache.flink.table.api.java.internal.BatchTableEnvironmentImpl.registerDataSet(BatchTableEnvironmentImpl.scala:69)
at fyy.test.table.Batchetabletest1.main(Batchetabletest1.java:19)
代码
POJO 类
public class WC{public String name;public Integer age;//问题原因所在 public WC(){}public WC(String name,Integer age){this.name = name;this.age = age;}public String getName() {return name;}public void setName(String name) {this.name = name;}public Integer getAge() {return age;}public void setAge(Integer age) {this.age = age;}
}
flink sqlimport org.apache.flink.api.java.DataSet;
import org.apache.flink.api.java.ExecutionEnvironment;
import org.apache.flink.table.api.Table;
import org.apache.flink.table.api.java.BatchTableEnvironment;public class Batchetabletest1 {public static void main(String[] args) throws Exception {ExecutionEnvironment env = ExecutionEnvironment.getExecutionEnvironment();BatchTableEnvironment tEnv = BatchTableEnvironment.create(env);DataSet<WC> input = env.fromElements(new WC("Hello", 1),new WC("zhisheng", 1),new WC("Hello", 1));tEnv.registerDataSet("WordCount", input, "name, age");Table table = tEnv.sqlQuery("SELECT name, SUM(age) as age FROM WordCount GROUP BY name"); DataSet<WC> result = tEnv.toDataSet(table, WC.class);result.print();}}
pom
<dependencies><dependency><groupId>org.apache.flink</groupId><artifactId>flink-scala_2.11</artifactId><version>1.10.0</version></dependency><!-- https://mvnrepository.com/artifact/org.apache.flink/flink-streaming-scala --><dependency><groupId>org.apache.flink</groupId><artifactId>flink-streaming-scala_2.11</artifactId><version>1.10.0</version></dependency><dependency><groupId>org.apache.flink</groupId><artifactId>flink-table-common</artifactId><version>${flink.version}</version></dependency><dependency><groupId>org.apache.flink</groupId><artifactId>flink-connector-kafka-0.11_2.11</artifactId><version>1.10.0</version></dependency><dependency><groupId>org.apache.bahir</groupId><artifactId>flink-connector-redis_2.11</artifactId><version>1.0</version><exclusions><exclusion><groupId>org.apache.flink</groupId><artifactId>flink-streaming-java_2.11</artifactId></exclusion></exclusions></dependency><dependency><groupId>org.apache.flink</groupId><artifactId>flink-connector-elasticsearch6_2.11</artifactId><version>1.10.0</version></dependency><dependency><groupId>mysql</groupId><artifactId>mysql-connector-java</artifactId><version>5.1.44</version></dependency><dependency><groupId>org.apache.flink</groupId><artifactId>flink-statebackend-rocksdb_2.11</artifactId><version>1.10.0</version></dependency><dependency><groupId>org.apache.flink</groupId><artifactId>flink-table-planner_2.11</artifactId><version>1.10.0</version></dependency><dependency><groupId>org.apache.flink</groupId><artifactId>flink-table-planner-blink_2.11</artifactId><version>1.10.0</version></dependency><dependency><groupId>org.apache.flink</groupId><artifactId>flink-csv</artifactId><version>1.10.0</version></dependency><dependency><groupId>org.apache.flink</groupId><artifactId>flink-table-api-scala-bridge_2.11</artifactId><version>1.10.0</version></dependency><dependency><groupId>org.projectlombok</groupId><artifactId>lombok</artifactId><version>1.18.4</version></dependency><!--加入下面两个依赖才会出现 Flink 的日志出来--><dependency><groupId>org.slf4j</groupId><artifactId>slf4j-api</artifactId><version>1.7.25</version></dependency><dependency><groupId>org.slf4j</groupId><artifactId>slf4j-simple</artifactId><version>1.7.25</version></dependency></dependencies>
flink Too many fields referenced from an atomic type相关推荐
- 【Flink】Too many fields referenced from an atomic type
1.背景 写了一段flink sql的代码如下 @Testdef mainTest(): Unit = {val settings = EnvironmentSettings.newInstance. ...
- 【flink】Flink 1.12.2 源码浅析 : Task 浅析
1.概述 转载:Flink 1.12.2 源码浅析 : Task 浅析 Task 表示TaskManager上并行 subtask 的一次执行. Task封装了一个Flink operator(也可能 ...
- (十八)Flink Table API SQL 编程指南 Table API 和Datastream API 集成
文章目录 DataStream 和 Table 之间的转换 依赖项和导入 配置 执行行为 datastream API table API 批处理运行时模式 Changelog统一 处理(仅插入)流 ...
- Flink - 尚硅谷- 大数据高级 Flink 技术精讲 - 2
七.Flink 时间语义与 Watermark 7.1 Flink 中的时间语义 7.2 设置 Event Time 7.3 水位线 - Watermark 7.3.1 基本概念 7.3.2 Wate ...
- 聊聊flink Table的groupBy操作
序 本文主要研究一下flink Table的groupBy操作 Table.groupBy flink-table_2.11-1.7.0-sources.jar!/org/apache/flink/t ...
- Supported Data Types(flink支持的数据类型)
文章目录 1.Tuples and Case Classes 2.POJOs 3.Primitive Types 4.General Class Types 5.Values 6.Hadoop Wri ...
- java中row类,Flink数据类型之POJO和Table中的Row
Published: 2019-09-15 22:10:00 tags: Flink Flink数据类型支持 TypeInformation主要是为Flink系统内有效的对数据结构类型进行管理, 对数 ...
- flink之SQL入门
SQL部分学习 Table API的特点Table API和SQL都是Apache Flink中高等级的分析API,SQL所具备的特点Table API也都具有,如下: 声明式 - 用户只关心做什么, ...
- Flink实战(五) Batch(DataSet) 运算的相关概念
文章目录 1. 示例程序 2. 转换函数 3. 数据源 配置CSV解析规则 递归读取输入路径目录 读取压缩文件 4. 数据输出 (Sink) 5. 迭代操作 Bulk Iterations(**批量迭 ...
- Flink学习:Flink常见报错
Flink Error 一.org.apache.flink.table.api.TableException: Only the first field can reference an atomi ...
最新文章
- 中国矿业大学计算机考研复试科目,中国矿业大学复试科目
- ActiveMQ在C#中的应用
- Linux下Debug模式启动Tomcat进行远程调试
- hive mysql 远程_ubuntu中为hive配置远程MYSQL database
- Javascript 基础知识之数据类型
- linux find命令的日常使用
- 微信防撤回python代码_Python实现微信防撤回
- 福大软工1816:项目测评
- python 循环语句结果存储_Python条件语句和循环语句
- 刚入职新公司做一些什么贡献_如果您有全职工作,如何为Kubernetes做贡献
- 【运动检测】基于matlab最大互信息运动目标检测【含Matlab源码 1607期】
- 安卓Activity布局简述
- qq机器人升级最新教程
- l7sa008b故障代码_Robertshaw 365-A8振动开关故障探测器
- 『杭电1982』Kaitou Kid - The Phantom Thief (1)
- 消息队列:SpringBoot集成RocketMQ的那些坑(真实有效、附源码)
- 【Android必备】构建一个App小部件(24)【代码块异常】
- 大学生的秘密,全都藏在快递里
- CTF线下赛AWD总结
- 携手酷依恋6元韩版服饰共享财富