Saltar al contenido principal

Kudu Upsert

Category: Data
Node id: cloudera-kudu-upsert

Standards: HIPAA, GDPR

Idempotently upsert rows into a Cloudera Kudu table (via Impala UPSERT). Server connection is configured on this node.

Runtime​

  • Performance tier: fast

Input ports​

NameTypeRequiredDescription
rowsjsonYesArray of row objects (column->value); all rows share the same columns

Output ports​

NameTypeRequiredDescription
resultjsonNoParsed JSON response payload from the vendor API
metadatajsonNoOperation, HTTP status code, and content length
successbooleanNoTrue if HTTP 2xx

Settings​

Basic​

SettingNameTypeRequiredDefaultAllowed valuesDescription
TabletablestringYesTarget Kudu table (optionally db-qualified).

Connection​

SettingNameTypeRequiredDefaultAllowed valuesDescription
Impala Hostimpala_hoststringNoImpala coordinator host (Flight SQL / HS2). Required for Impala operations.
Impala Portimpala_portnumberNoImpala port (Flight SQL default 443/tls; HS2 21050).
Impala Protocolimpala_protocolenumNoflightsqlflightsql, hs2Wire protocol: Arrow Flight SQL (preferred) or HiveServer2 Thrift.
Databaseimpala_databasestringNoDefault Impala database/schema for unqualified table names.
Impala TLSimpala_tlsbooleanNotrueUse TLS for the Impala connection (grpc+tls for Flight SQL, https for HS2).
HS2 HTTP Pathimpala_http_pathstringNocliserviceHiveServer2 HTTP path for the hs2 protocol (Cloudera Data Warehouse uses 'cliservice').
HDFS / httpFS URLhdfs_urlstringNoWebHDFS/httpFS base URL, e.g. https://httpfs.cluster:14000. Required for HDFS operations.
HDFS Base Pathhdfs_basestringNoBase path that relative HDFS paths resolve against, e.g. /data/dicom.

Auth​

SettingNameTypeRequiredDefaultAllowed valuesDescription
Impala Username (LDAP)impala_usernamestringNoLDAP user for Impala basic-auth (Cloudera Data Warehouse). Leave blank to use Kerberos.
Impala Password (LDAP)impala_passwordsecretNoLDAP password for the Impala user. Stored as a secret.
Kerberos Principalkerberos_principalstringNoService principal, e.g. tietai@REALM. Leave blank for a non-Kerberized cluster.
Kerberos Realmkerberos_realmstringNoRealm (defaults to the part after @ in the principal).
KDC Hostkerberos_kdcstringNoKey Distribution Center host, e.g. kdc.cluster.
Keytab (base64)keytab_base64secretNoBase64-encoded keytab for the principal. Stored as a secret; sent to Connect over the call.

Advanced​

SettingNameTypeRequiredDefaultAllowed valuesDescription
Mock (dev)mockbooleanNofalseUse an in-memory mock backend (no cluster/Kerberos) for local development and testing.

Runtime notes​

  • result.count is the number of rows upserted.

See Build any workflow for how to put nodes together and Ports, types and data flow for how port types connect.

¿Algo no está claro? Envíe sus comentarios sobre la documentación por correo electrónico..