Classe abstrata DataSink - AWS Glue

Classe abstrata DataSink

Pacote:   com.amazonaws.services.glue

abstract class DataSink

O gravador analógico a um DataSource. O DataSink encapsula um destino e um formato no qual um DynamicFrame pode ser gravado.

Def writeDynamicFrame

def writeDynamicFrame( frame : DynamicFrame, callSite : CallSite = CallSite("Not provided", "") ) : DynamicFrame

Def pyWriteDynamicFrame

def pyWriteDynamicFrame( frame : DynamicFrame, site : String = "Not provided", info : String = "" )

Def WriteDataFrame

def writeDataFrame(frame: DataFrame, glueContext: GlueContext, callSite: CallSite = CallSite("Not provided", "") ): DataFrame

Def pyWriteDataFrame

def pyWriteDataFrame(frame: DataFrame, glueContext: GlueContext, site: String = "Not provided", info: String = "" ): DataFrame

Def setCatalogInfo

def setCatalogInfo(catalogDatabase: String, catalogTableName : String, catalogId : String = "")

Def supportsFormat

def supportsFormat( format : String ) : Boolean

Def setFormat

def setFormat( format : String, options : JsonOptions ) : Unit

Def withFormat

def withFormat( format : String, options : JsonOptions = JsonOptions.empty ) : DataSink

Def setAccumulableSize

def setAccumulableSize( size : Int ) : Unit

Def getOutputErrorRecordsAccumulable

def getOutputErrorRecordsAccumulable : Accumulable[List[OutputError], OutputError]

Def errorsAsDynamicFrame

def errorsAsDynamicFrame : DynamicFrame

Objeto DataSink

object DataSink

Def recordMetrics

def recordMetrics( frame : DynamicFrame, ctxt : String ) : DynamicFrame