HDFS Read
Category: Data
Node id: cloudera-hdfs-read
Standards: HIPAA, GDPR
Read a single object's bytes from Cloudera HDFS (WebHDFS/httpFS). Server connection is configured on this node.
Runtime
- Performance tier:
variable
Input ports
| Name | Type | Required | Description |
|---|---|---|---|
path | text | No | Optional HDFS path overriding config.path |
Output ports
| Name | Type | Required | Description |
|---|---|---|---|
file | binary | No | The object bytes |
meta | json | No | {path, size} |
success | boolean | No | True on HTTP 2xx |
Settings
Basic
| Setting | Name | Type | Required | Default | Allowed values | Description |
|---|---|---|---|---|---|---|
| HDFS Path | path | string | No | Path of the object to read (absolute, or relative to HDFS base). |
Connection
| Setting | Name | Type | Required | Default | Allowed values | Description |
|---|---|---|---|---|---|---|
| Impala Host | impala_host | string | No | Impala coordinator host (Flight SQL / HS2). Required for Impala operations. | ||
| Impala Port | impala_port | number | No | Impala port (Flight SQL default 443/tls; HS2 21050). | ||
| Impala Protocol | impala_protocol | enum | No | flightsql | flightsql, hs2 | Wire protocol: Arrow Flight SQL (preferred) or HiveServer2 Thrift. |
| Database | impala_database | string | No | Default Impala database/schema for unqualified table names. | ||
| Impala TLS | impala_tls | boolean | No | true | Use TLS for the Impala connection (grpc+tls for Flight SQL, https for HS2). | |
| HS2 HTTP Path | impala_http_path | string | No | cliservice | HiveServer2 HTTP path for the hs2 protocol (Cloudera Data Warehouse uses 'cliservice'). | |
| HDFS / httpFS URL | hdfs_url | string | No | WebHDFS/httpFS base URL, e.g. https://httpfs.cluster:14000. Required for HDFS operations. | ||
| HDFS Base Path | hdfs_base | string | No | Base path that relative HDFS paths resolve against, e.g. /data/dicom. |
Auth
| Setting | Name | Type | Required | Default | Allowed values | Description |
|---|---|---|---|---|---|---|
| Impala Username (LDAP) | impala_username | string | No | LDAP user for Impala basic-auth (Cloudera Data Warehouse). Leave blank to use Kerberos. | ||
| Impala Password (LDAP) | impala_password | secret | No | LDAP password for the Impala user. Stored as a secret. | ||
| Kerberos Principal | kerberos_principal | string | No | Service principal, e.g. tietai@REALM. Leave blank for a non-Kerberized cluster. | ||
| Kerberos Realm | kerberos_realm | string | No | Realm (defaults to the part after @ in the principal). | ||
| KDC Host | kerberos_kdc | string | No | Key Distribution Center host, e.g. kdc.cluster. | ||
| Keytab (base64) | keytab_base64 | secret | No | Base64-encoded keytab for the principal. Stored as a secret; sent to Connect over the call. |
Advanced
| Setting | Name | Type | Required | Default | Allowed values | Description |
|---|---|---|---|---|---|---|
| Mock (dev) | mock | boolean | No | false | Use an in-memory mock backend (no cluster/Kerberos) for local development and testing. |
See Build any workflow for how to put nodes together and Ports, types and data flow for how port types connect.
Quelque chose n'est pas clair ? Envoyez vos commentaires sur la documentation par courriel.