Setting data handling options - Amazon Redshift

Setting data handling options

You can set table parameters when you create external tables to tailor the data being queried in external tables. Otherwise, ORC scanner errors can occur. For more information, see TABLE PROPERTIES in CREATE EXTERNAL TABLE. For examples, see Data handling examples. For a list of errors, see SVL_SPECTRUM_SCAN_ERROR.

You can set the following TABLE PROPERTIES when you create external tables to specify input handling for data being queried in external tables.

  • surplus_char_handling to specify input handling for surplus characters in columns containing VARCHAR, CHAR, and string data.

  • invalid_char_handling to specify input handling for invalid characters in columns containing VARCHAR, CHAR, and string data. When you specify REPLACE for invalid_char_handling, you can specify the replacement character to use.

  • numeric_overflow_handling to specify cast overflow handling in columns containing integer and decimal data.

You can set a configuration option to cancel queries that exceed a maximum number of errors. For more information, see spectrum_query_maxerror.