[
https://issues.apache.org/jira/browse/HIVE-27350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Karthik resolved HIVE-27350.
----------------------------
Target Version/s: 3.1.2
Assignee: Karthik
Resolution: Fixed
This is not an Issue and could be ignored. The reason of the exception is due
to the duplicate column available in the Storage Descriptor.
This we were able to find only when we upgraded to 4.0.0-alpha-2 and exception
was clear since column_name is unique in COLUMNS_V2 table
> Unable to Create Table with 380+ Columns
> ----------------------------------------
>
> Key: HIVE-27350
> URL: https://issues.apache.org/jira/browse/HIVE-27350
> Project: Hive
> Issue Type: Bug
> Components: Metastore, Standalone Metastore
> Affects Versions: 3.1.2
> Environment: Production
> Reporter: Karthik
> Assignee: Karthik
> Priority: Blocker
>
> When we try to Iceberg table via Hive MetaStore with 388 Columns we get below
> exception:
> {code:java}
> org.apache.hadoop.hive.metastore.api.MetaException: Add request failed :
> INSERT INTO `COLUMNS_V2`
> (`CD_ID`,`COMMENT`,`COLUMN_NAME`,`TYPE_NAME`,`INTEGER_IDX`) VALUES
> (?,?,?,?,?) at
> org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$create_table_with_environment_context_result$create_table_with_environment_context_resultStandardScheme.read(ThriftHiveMetastore.java:54908)
> ~[hive-standalone-metastore-3.1.3.jar:3.1.3] at
> org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$create_table_with_environment_context_result$create_table_with_environment_context_resultStandardScheme.read(ThriftHiveMetastore.java:54876)
> ~[hive-standalone-metastore-3.1.3.jar:3.1.3] at
> org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$create_table_with_environment_context_result.read(ThriftHiveMetastore.java:54802)
> ~[hive-standalone-metastore-3.1.3.jar:3.1.3] at
> org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:86)
> ~[libthrift-0.9.3.jar:0.9.3] at
> org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.recv_create_table_with_environment_context(ThriftHiveMetastore.java:1556)
> ~[hive-standalone-metastore-3.1.3.jar:3.1.3] at
> org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.create_table_with_environment_context(ThriftHiveMetastore.java:1542)
> ~[hive-standalone-metastore-3.1.3.jar:3.1.3] at
> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.create_table_with_environment_context(HiveMetaStoreClient.java:2867)
> ~[hive-standalone-metastore-3.1.3.jar:3.1.3] at
> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.createTable(HiveMetaStoreClient.java:837)
> ~[hive-standalone-metastore-3.1.3.jar:3.1.3] at
> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.createTable(HiveMetaStoreClient.java:822)
> ~[hive-standalone-metastore-3.1.3.jar:3.1.3] at
> jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?]
> at
> jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
> ~[?:?] at
> jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> ~[?:?] at java.lang.reflect.Method.invoke(Method.java:568) ~[?:?]
> at
> org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:208)
> ~[hive-standalone-metastore-3.1.3.jar:3.1.3] at
> jdk.proxy2.$Proxy20.createTable(Unknown Source) ~[?:?] at
> org.apache.iceberg.hive.HiveTableOperations.lambda$persistTable$4(HiveTableOperations.java:405)
> ~[iceberg-spark-runtime-3.2_2.12-1.1.0.jar:?] at
> org.apache.iceberg.ClientPoolImpl.run(ClientPoolImpl.java:58)
> ~[iceberg-spark-runtime-3.2_2.12-1.1.0.jar:?] at
> org.apache.iceberg.ClientPoolImpl.run(ClientPoolImpl.java:51)
> ~[iceberg-spark-runtime-3.2_2.12-1.1.0.jar:?] at
> org.apache.iceberg.hive.CachedClientPool.run(CachedClientPool.java:82)
> ~[iceberg-spark-runtime-3.2_2.12-1.1.0.jar:?] at
> org.apache.iceberg.hive.HiveTableOperations.persistTable(HiveTableOperations.java:403)
> ~[iceberg-spark-runtime-3.2_2.12-1.1.0.jar:?] at
> org.apache.iceberg.hive.HiveTableOperations.doCommit(HiveTableOperations.java:327)
> ~[iceberg-spark-runtime-3.2_2.12-1.1.0.jar:?] at
> org.apache.iceberg.BaseMetastoreTableOperations.commit(BaseMetastoreTableOperations.java:135)
> ~[iceberg-spark-runtime-3.2_2.12-1.1.0.jar:?] at
> org.apache.iceberg.BaseMetastoreCatalog$BaseMetastoreCatalogTableBuilder.create(BaseMetastoreCatalog.java:196)
> ~[iceberg-spark-runtime-3.2_2.12-1.1.0.jar:?]
> {code}
> When we reduce columns size 380, Table is created. Our metastore DB is
> Postgres.
> Validated SD_PARAMS and SERDE_PARAMS table, both table has PARAM_VALUE as
> TEXT datatype only.
> This is specific to COLUMNS_V2 table. Changed TYPE_NAME to TEXT type as well
> and Restarted Metastore but didn't work.
> For reference Below is the Table Object(toString)
> {code:java}
> Table(tableName:credit_bureau, dbName:lz_agrinetwork,
> owner:karthikeyankarunanithi-NC23599, createTime:587637,
> lastAccessTime:587637, retention:2147483647,
> sd:StorageDescriptor(cols:[FieldSchema(name:creditBureauRating_num_dpd_0_instances_l3m_al,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_60_instances_l6m_al, type:double,
> comment:null), FieldSchema(name:computedCreditScore, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_30_instances_l6m_cc, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_60_instances_l12m_unsec,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_60_instances_l12m_gl,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_balc_sanc_amt_ratio_total, type:double,
> comment:null), FieldSchema(name:creditBureauRating_count_60plus_12m,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_90_instances_l6m_sec,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_count_sec_loans_opened_3m, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_0_instances_l6m_sec, type:double,
> comment:null), FieldSchema(name:creditBureauRating_Max_DPD_24m_sec,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_Max_DPD_ever_unsec, type:double,
> comment:null), FieldSchema(name:creditBureauRating_count_HL_open,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_0_instances_ever_twl,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_Max_DPD_6m_HL, type:double,
> comment:null), FieldSchema(name:creditBureauRating_count_OD_ever,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_30_instances_ever_unsec,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_0_instances_l3m_bl, type:double,
> comment:null), FieldSchema(name:creditBureauRating_num_dpd_0_instances_l3m,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_Max_DPD_12m_sec, type:double,
> comment:null), FieldSchema(name:creditBureauRating_Max_DPD_12m_GL,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_60_instances_l6m_bl, type:double,
> comment:null), FieldSchema(name:creditBureauRating_Max_DPD_36m_HL,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_90_instances_ever_cvl,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_count_open_unsecured, type:double,
> comment:null), FieldSchema(name:creditBureauRating_Max_DPD_6m_GL,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_0_instances_ever, type:double,
> comment:null), FieldSchema(name:creditBureauRating_num_dpd_90_instances_l12m,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_0_instances_l12m_cc, type:double,
> comment:null), FieldSchema(name:creditBureauRating_num_dpd_60_instances_l12m,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_90_instances_l24m, type:double,
> comment:null), FieldSchema(name:creditBureauRating_Max_DPD_36m_sec,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_max_DPD_12m_CC, type:double,
> comment:null), FieldSchema(name:creditBureauRating_num_dpd_30_instances_l6m,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_balc_sanc_amt_ratio_unsec, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_Total_unsec_sanc_amount_6m, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_60_instances_l12m_cvl,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_active_overdue_loans_l24m,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_count_loans_closed_6m, type:double,
> comment:null), FieldSchema(name:creditBureauRating_Max_DPD_12m_unsec,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_30_instances_l24m, type:double,
> comment:null), FieldSchema(name:creditBureauRating_num_dpd_30_instances_l12m,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_Max_DPD_12m_HL, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_90_instances_l12m_cc,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_60_instances_l6m_cc, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_30_instances_active_l24m,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_60_instances_l3m, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_0_instances_l3m_cc, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_90_instances_ever_twl,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_90_instances_l6m_al, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_0_instances_l6m_pl, type:double,
> comment:null), FieldSchema(name:realmId, type:string, comment:null),
> FieldSchema(name:creditBureauRating_count_closed_loans, type:double,
> comment:null), FieldSchema(name:creditBureauRating_cc_highcredit_ratio,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_count_AL_open, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_0_instances_l12m_bl, type:double,
> comment:null), FieldSchema(name:creditBureauRating_count_active_closed_6m,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_0_instances_ever_cvl,
> type:double, comment:null), FieldSchema(name:userId, type:string,
> comment:null),
> FieldSchema(name:creditBureauRating_Ratio_opened_closed_loans_3m,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_Max_DPD_6m_sec, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_90_instances_l6m_bl, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_60_instances_l12m_twl,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_active_cc_limit, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_90_instances_l3m_pl, type:double,
> comment:null), FieldSchema(name:creditBureauRating_Max_DPD_12m_BL,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_cc_balc_highcredit_ratio, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_60_instances_l12m_cc,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_90_instances_l12m_al,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_0_instances_l6m, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_0_instances_l12m_al, type:double,
> comment:null), FieldSchema(name:creditBureauRating_Max_DPD_ever_BL,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_60_instances_l12m_bl,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_30_instances_l3m, type:double,
> comment:null), FieldSchema(name:creditBureauRating_max_emi_l24m, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_30_instances_l6m_sec,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_90_instances_l12m_bl,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_Max_DPD_ever_AL, type:double,
> comment:null), FieldSchema(name:creditBureauRating_count_loans_closed_3m,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_90_instances_l12m_sec,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_ratio_PL_open_total, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_0_instances_l3m_unsec,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_Max_DPD_12m_CC, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_60_instances_l12m_al,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_count_GL_ever, type:double,
> comment:null), FieldSchema(name:creditBureauRating_ratio_open_loans,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_count_sec_loans_opened_6m, type:double,
> comment:null), FieldSchema(name:creditBureauRating_active_od_bl_limit,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_Ratio_0plus_6m_12m, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_30_instances_l6m_al, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_Ratio_opened_closed_loans_6m,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_0_instances_l12m_unsec,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_60_instances_l6m_sec,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_Max_DPD_3m_AL, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_90_instances_l3m_unsec,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_30_instances_l6m_bl, type:double,
> comment:null), FieldSchema(name:creditBureauRating_Max_DPD_3m_BL,
> type:double, comment:null), FieldSchema(name:externalId, type:string,
> comment:null), FieldSchema(name:creditBureauRating_thick_thin_flag,
> type:string, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_6m,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_ratio_HL_open_total, type:double,
> comment:null), FieldSchema(name:creditBureauRating_num_dpd_15_instances_l3m,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_ratio_BL_open_total, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_30_instances_l12m_pl,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_suit_filed_ever_flag, type:boolean,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_90_instances_l6m_gl, type:double,
> comment:null), FieldSchema(name:creditBureauRating_balc_sanc_amt_ratio_sec,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_Max_DPD_3m_CVL, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_60_instances_l3m_cvl,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_loan_facilities_availed_l3m,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_cc_utilization_ratio, type:double,
> comment:null), FieldSchema(name:id, type:string, comment:null),
> FieldSchema(name:creditBureauRating_Max_DPD_3m_TWL, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_60_instances_l3m_twl,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_Max_DPD_24m_PL, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_90_instances_l6m_hl, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_30_instances_l12m_al,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_count_PL_open, type:double,
> comment:null), FieldSchema(name:creditBureauRating_count_CC_ever,
> type:double, comment:null), FieldSchema(name:creditBureauRating_report_date,
> type:string, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_60_instances_ever_twl,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_30_instances_l12m_twl,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_count_loans_doubtful, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_30_instances_l3m_unsec,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_30_instances_closed_l24m,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_30_instances_l12m_cvl,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_settled_ever_flag, type:boolean,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_0_instances_l3m_cvl, type:double,
> comment:null), FieldSchema(name:creditBureauRating_Max_DPD_3m, type:double,
> comment:null), FieldSchema(name:creditBureauRating_Max_DPD_6m_BL,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_count_LABD_open, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_30_instances_l12m_bl,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_Max_DPD_36m_CC, type:double,
> comment:null), FieldSchema(name:creditBureauRating_wrt_off_setld_ever_flag,
> type:boolean, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_0_instances_l3m_twl, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_0_instances_l6m_hl, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_30_instances_l12m_cc,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_0_instances_l12m_sec,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_60_instances_ever_cvl,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_Max_DPD_36m_BL, type:double,
> comment:null), FieldSchema(name:creditBureauRating_count_loans_suit_filed,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_Max_DPD_12m_AL, type:double,
> comment:null), FieldSchema(name:creditBureauRating_Max_DPD_ever_CC,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_Max_DPD_6m_AL, type:double,
> comment:null), FieldSchema(name:creditBureauRating_Total_sec_sanc_amount_36m,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_Total_sec_sanc_amount_24m, type:double,
> comment:null), FieldSchema(name:creditBureauRating_Total_sec_sanc_amount_12m,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_jlg_loan_bal_amt, type:double,
> comment:null), FieldSchema(name:creditBureauRating_count_unsecured,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_0_instances_l6m_gl, type:double,
> comment:null), FieldSchema(name:creditBureauRating_Max_DPD_36m_AL,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_count_BL_ever, type:double,
> comment:null), FieldSchema(name:creditBureauRating_Max_DPD_ever_CVL,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_count_loans_closed_36m, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_60_instances_l3m_pl, type:double,
> comment:null), FieldSchema(name:creditBureauRating_count_loans_closed_24m,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_count_loans_closed_12m, type:double,
> comment:null), FieldSchema(name:creditBureauRating_count_loans_wrt_off_sttld,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_30_instances_l3m_bl, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_60_instances_l3m_unsec,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_30_instances_l6m_gl, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_90_instances_l6m_cc, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_0_instances_l6m_bl, type:double,
> comment:null), FieldSchema(name:creditBureauRating_Max_DPD_ever_TWL,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_count_AL_ever, type:double,
> comment:null), FieldSchema(name:creditBureauRating_Ratio_0plus_3m_ever,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_30_instances_l3m_cc, type:double,
> comment:null), FieldSchema(name:creditBureauRating_count_open_secured,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_balc_sanc_amt_ratio_PL, type:double,
> comment:null), FieldSchema(name:creditBureauRating_ratio_0plus_3m_12m,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_current_overdue, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_30_instances_l3m_al, type:double,
> comment:null), FieldSchema(name:creditBureauRating_Max_DPD_ever, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_0_instances_l6m_al, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_30_instances_l6m_hl, type:double,
> comment:null), FieldSchema(name:creditBureauRating_count_credit_lines,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_Max_DPD_6m_CC, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_90_instances_l12m_gl,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_Max_DPD_ever_HL, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_30_instances_l3m_sec,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_Max_DPD_36m_GL, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_30_instances_ever_pl,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_90_instances_ever_pl,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_60_instances_ever_al,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_30_instances_l12m_gl,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_90_instances_l3m_sec,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_90_instances_l12m_hl,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_balc_sanc_amt_ratio_LABD, type:double,
> comment:null), FieldSchema(name:creditBureauRating_Max_DPD_ever_GL,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_ratio_GL_open_total, type:double,
> comment:null), FieldSchema(name:creditBureauRating_Total_sec_sanc_amount_3m,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_30_instances_ever_sec,
> type:double, comment:null), FieldSchema(name:vintageWithNinjacart,
> type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_36m,
> type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_24m,
> type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_12m,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_60_instances_l6m, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_0_instances_l6m_cc, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_30_instances_l12m_hl,
> type:double, comment:null), FieldSchema(name:creditBureauRating_count_loans,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_0_instances_ever_bl, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_90_instances_l6m_cvl,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_Max_DPD_24m_CVL, type:double,
> comment:null), FieldSchema(name:creditBureauRating_count_BL_open,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_0_instances_ever_sec,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_count_LABD_ever, type:double,
> comment:null), FieldSchema(name:creditBureauRating_active_od_limit,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_90_instances_l3m_al, type:double,
> comment:null), FieldSchema(name:creditBureauRating_count_CC_open,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_Max_DPD_24m_HL, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_90_instances_l6m_twl,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_0_instances_l6m_cvl, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_90_instances_ever_al,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_count_loans_loss, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_60_instances_l3m_cc, type:double,
> comment:null), FieldSchema(name:creditBureauRating_Total_sanc_amount_12m,
> type:double, comment:null), FieldSchema(name:creditBureauRating_active_emi,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_0_instances_ever_al, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_90_instances_ever_cc,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_90_instances_l6m_pl, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_0_instances_l6m_twl, type:double,
> comment:null), FieldSchema(name:creditBureauRating_Max_DPD_36m_TWL,
> type:double, comment:null), FieldSchema(name:creditBureauRating_updated_ts,
> type:string, comment:null),
> FieldSchema(name:creditBureauRating_Total_sanc_amount_36m, type:double,
> comment:null), FieldSchema(name:creditBureauRating_Total_sanc_amount_24m,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_60_instances_ever_cc,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_90_instances_l3m_bl, type:double,
> comment:null), FieldSchema(name:creditBureauRating_ratio_open_secured,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_Ratio_0plus_3m_6m, type:double,
> comment:null), FieldSchema(name:creditBureauRating_Max_DPD_24m_GL,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_60_instances_ever_bl,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_Max_DPD_12m_CVL, type:double,
> comment:null), FieldSchema(name:creditBureauRating_count_loans_opened_3m,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_90_instances_ever_bl,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_balc_sanc_amt_ratio_CL, type:double,
> comment:null), FieldSchema(name:creditBureauRating_Total_sec_sanc_amount_6m,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_count_PL_ever, type:double,
> comment:null), FieldSchema(name:creditBureauRating_ratio_open_unsecured,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_Total_unsec_sanc_amount_36m, type:double,
> comment:null), FieldSchema(name:creditBureauRating_Max_DPD_12m_TWL,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_count_GL_open, type:double,
> comment:null), FieldSchema(name:creditBureauRating_Max_DPD_6m_CVL,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_0_instances_l6m_unsec,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_Max_DPD_6m_unsec, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_90_instances_ever_sec,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_60_instances_l3m_al, type:double,
> comment:null), FieldSchema(name:creditBureauRating_Max_DPD_36m_CVL,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_balc_sanc_amt_ratio_BL, type:double,
> comment:null), FieldSchema(name:creditBureauRating_Max_DPD_6m_TWL,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_0_instances_ever_cc, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_30_instances_l6m_unsec,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_60_instances_l12m_sec,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_60_instances_l3m_bl, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_Total_unsec_sanc_amount_12m, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_Total_unsec_sanc_amount_24m, type:double,
> comment:null), FieldSchema(name:creditBureauRating_Max_DPD_24m_TWL,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_balc_sanc_amt_ratio_AL, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_30_instances_l6m_twl,
> type:double, comment:null), FieldSchema(name:source, type:string,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_60_instances_ever_hl,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_90_instances_ever_unsec,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_90_instances_l12m_cvl,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_30_instances_l6m_cvl,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_30_instances_l6m_pl, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_60_instances_l3m_gl, type:double,
> comment:null), FieldSchema(name:creditBureauRating_balc_sanc_amt_ratio_HL,
> type:double, comment:null), FieldSchema(name:creditBureauRating_max_cc_limit,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_count_loans_opened_6m, type:double,
> comment:null), FieldSchema(name:creditBureauRating_jlg_loan_active_emi,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_90_instances_l12m_twl,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_90_instances_ever_gl,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_60_instances_ever_gl,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_count_secured, type:double,
> comment:null), FieldSchema(name:creditBureauRating_Max_DPD_3m_PL,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_Ratio_opened_closed_loans_12m,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_Ratio_opened_closed_loans_24m,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_balc_sanc_amt_ratio_GL, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_60_instances_l3m_hl, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_0_instances_l12m_pl, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_0_instances_ever_hl, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_60_instances_l6m_cvl,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_30_instances_l3m_hl, type:double,
> comment:null), FieldSchema(name:creditBureauRating_doubtful_ever_flag,
> type:boolean, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_90_instances_ever_hl,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_30_instances_l12m_unsec,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_Ratio_opened_closed_loans_36m,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_ratio_secured_loans, type:double,
> comment:null), FieldSchema(name:creditBureauRating_count_write_off_loans,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_count_OD_open, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_30_instances_ever_gl,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_60_instances_l6m_twl,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_90_instances_l3m_cc, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_60_instances_l12m_pl,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_count_settled_loans, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_30_instances_l3m_gl, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_90_instances_l12m_pl,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_60_instances_l6m_pl, type:double,
> comment:null), FieldSchema(name:creditBureauRating_write_off_ever_flag,
> type:boolean, comment:null),
> FieldSchema(name:creditBureauRating_count_open_loans, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_0_instances_ever_gl, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_30_instances_ever_hl,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_0_instances_l3m_pl, type:double,
> comment:null), FieldSchema(name:creditBureauRating_num_delinquent_l24m,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_Max_DPD_ever_PL, type:double,
> comment:null), FieldSchema(name:vintageBusinessName, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_60_instances_l3m_sec,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_write_off_settled_l24m, type:double,
> comment:null), FieldSchema(name:creditBureauRating_loss_ever_flag,
> type:boolean, comment:null),
> FieldSchema(name:creditBureauRating_Max_DPD_3m_CC, type:double,
> comment:null), FieldSchema(name:creditBureauRating_Max_DPD_6m_PL,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_Max_DPD_24m_unsec, type:double,
> comment:null), FieldSchema(name:creditBureauRating_count_HL_ever,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_Ratio_0plus_3m_12m, type:double,
> comment:null), FieldSchema(name:creditBureauRating_balc_sanc_amt_ratio_CVL,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_90_instances_l12m_unsec,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_60_instances_ever_sec,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_unsecured_sanction_flag, type:boolean,
> comment:null), FieldSchema(name:creditBureauRating_Total_sanc_amount_3m,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_Max_DPD_36m_PL, type:double,
> comment:null), FieldSchema(name:creditBureauRating_balc_sanc_amt_ratio_TWL,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_30_instances_l12m_sec,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_90_instances_l6m_unsec,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_ratio_LABD_open_total, type:double,
> comment:null), FieldSchema(name:creditBureauRating_Max_DPD_3m_unsec,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_0_instances_l12m_cvl,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_Max_DPD_12m_PL, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_90_instances_l3m_gl, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_0_instances_l3m_sec, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_0_instances_l12m_twl,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_active_od_bl_flag, type:boolean,
> comment:null), FieldSchema(name:creditBureauRating_Max_DPD_3m_sec,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_90_instances_l3m_hl, type:double,
> comment:null), FieldSchema(name:creditBureauRating_Max_DPD_3m_GL,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_60_instances_ever_pl,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_0_instances_ever_unsec,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_Total_sanc_amount_6m, type:double,
> comment:null), FieldSchema(name:creditBureauRating_num_dpd_1_instances_l3m,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_ratio_CC_open_total, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_30_instances_ever_al,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_90_instances_l6m, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_count_sec_loans_opened_24m, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_count_sec_loans_opened_36m, type:double,
> comment:null), FieldSchema(name:creditBureauRating_num_dpd_0_instances_l12m,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_count_sec_loans_opened_12m, type:double,
> comment:null), FieldSchema(name:creditBureauRating_Max_DPD_3m_HL,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_0_instances_l12m_hl, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_30_instances_ever_cc,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_Total_unsec_sanc_amount_3m, type:double,
> comment:null), FieldSchema(name:creditBureauRating_bureau_score, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_30_instances_ever_bl,
> type:double, comment:null), FieldSchema(name:count_active_closed_6m,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_Max_DPD_24m_CC, type:double,
> comment:null), FieldSchema(name:creditBureauRating_expiry_date, type:string,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_60_instances_l6m_gl, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_0_instances_l12m_gl, type:double,
> comment:null), FieldSchema(name:creditBureauRating_count_loans_opened_36m,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_count_loans_opened_24m, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_60_instances_ever_unsec,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_write_off_l24m, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_30_instances_l3m_cvl,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_90_instances_l3m_cvl,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_total_sanc_amount_3m, type:double,
> comment:null), FieldSchema(name:creditBureauRating_Max_DPD_24m_BL,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_0_instances_ever_pl, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_30_instances_l3m_twl,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_0_instances_l3m_gl, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_90_instances_l3m_twl,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_Max_DPD_36m_unsec, type:double,
> comment:null), FieldSchema(name:creditBureauRating_balc_sanc_amt_ratio_LAS,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_60_instances_l6m_hl, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_60_instances_l12m_hl,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_Max_DPD_ever_sec, type:double,
> comment:null), FieldSchema(name:creditBureauRating_num_dpd_90_instances_ever,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_30_instances_ever_cvl,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_30_instances_ever, type:double,
> comment:null), FieldSchema(name:creditBureauRating_num_dpd_60_instances_ever,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_ratio_AL_open_total, type:double,
> comment:null), FieldSchema(name:creditBureauRating_Max_DPD_24m_AL,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_60_instances_l6m_unsec,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_count_loans_opened_12m, type:double,
> comment:null), FieldSchema(name:creditBureauRating_num_dpd_90_instances_l3m,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_30_instances_l3m_pl, type:double,
> comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_0_instances_l3m_hl, type:double,
> comment:null), FieldSchema(name:creditBureauRating_bureau_vintage,
> type:double, comment:null),
> FieldSchema(name:creditBureauRating_num_dpd_30_instances_ever_twl,
> type:double, comment:null), FieldSchema(name:sys__processed_ts,
> type:timestamp, comment:null), FieldSchema(name:sys__event_id, type:string,
> comment:null)],
> location:abfs://lakehousep...@ncetldata.dfs.core.windows.net/landingzone/lz_agrinetwork.db/credit_bureau,
> inputFormat:org.apache.hadoop.mapred.FileInputFormat,
> outputFormat:org.apache.hadoop.mapred.FileOutputFormat, compressed:false,
> numBuckets:0, serdeInfo:SerDeInfo(name:null,
> serializationLib:org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe,
> parameters:{}), bucketCols:null, sortCols:null, parameters:null),
> partitionKeys:[], parameters:{EXTERNAL=TRUE, write.format.default=parquet,
> write.metadata.previous-versions-max=5,
> metadata_location=abfs://lakehousep...@ncetldata.dfs.core.windows.net/landingzone/lz_agrinetwork.db/credit_bureau/metadata/00000-d32267f0-61ba-4a3a-8571-b9aa24b7f921.metadata.json,
> write.metadata.delete-after-commit.enabled=true,
> default-partition-spec={"spec-id":0,"fields":[{"name":"sys__processed_ts_hour","transform":"hour","source-id":387,"field-id":1000}]},
> snapshot-count=0, uuid=f491f592-d865-4fee-b69e-852bcd82cfca,
> table_type=ICEBERG}, viewOriginalText:null, viewExpandedText:null,
> tableType:EXTERNAL_TABLE, catName:hive, ownerType:USER){code}
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
