报错如下:
05-01-2022 10:21:01 CST ods_to_dwd_log INFO - No Stats for sonkwo@ods_event_log, Columns: ip_region, create_time, ip, source_parameter, v_uuid, account_region, visit_page_time, version, url, path, account_id, event_type, detail_parameter, account_register_time, page_name, host, page_parameter, client, goto_parameter, id, event_time
05-01-2022 10:21:01 CST ods_to_dwd_log INFO - No Stats for sonkwo@ods_event_log, Columns: account_id, v_uuid, id, event_time
05-01-2022 10:21:01 CST ods_to_dwd_log INFO - No Stats for sonkwo@ods_event_log, Columns: ip_region, create_time, ip, source_parameter, v_uuid, account_region, visit_page_time, version, url, path, account_id, event_type, detail_parameter, account_register_time, page_name, host, page_parameter, client, goto_parameter, id, event_time
05-01-2022 10:21:04 CST ods_to_dwd_log INFO - FAILED: SemanticException Failed to get a spark session: org.apache.hadoop.hive.ql.metadata.HiveException: Failed to create Spark client

博客作者通过分析Azkaban执行失败的日志,发现了一个看似无关紧要的细节——使用了‘select * from’的SQL语句。在Hive中,推荐指定具体列名以提高效率。作者将‘select *’改为指定列名后,问题得到解决,Azkaban作业成功运行。这个经历强调了日志分析的重要性,即使小问题也可能成为关键所在。
1万+

被折叠的 条评论
为什么被折叠?



