Docs Home Pulumi IaC Pulumi ESC Pulumi Cloud Packages Tutorials
  1. Packages
  2. AWS Cloud Control
  3. API Docs
  4. glue
  5. Job

We recommend new projects start with resources from the AWS provider.

AWS Cloud Control v1.9.0 published on Monday, Nov 18, 2024 by Pulumi
pulumi/pulumi-aws-native

aws-native.glue.Job

Explore with Pulumi AI

aws-native logo

We recommend new projects start with resources from the AWS provider.

AWS Cloud Control v1.9.0 published on Monday, Nov 18, 2024 by Pulumi
pulumi/pulumi-aws-native

    Resource Type definition for AWS::Glue::Job

    Create Job Resource

    Resources are created with functions called constructors. To learn more about declaring and configuring resources, see Resources.

    Constructor syntax

    new Job(name: string, args: JobArgs, opts?: CustomResourceOptions);
    @overload
def Job(resource_name: str,
        args: JobArgs,
        opts: Optional[ResourceOptions] = None)

@overload
def Job(resource_name: str,
        opts: Optional[ResourceOptions] = None,
        role: Optional[str] = None,
        command: Optional[JobCommandArgs] = None,
        log_uri: Optional[str] = None,
        max_retries: Optional[float] = None,
        description: Optional[str] = None,
        execution_class: Optional[str] = None,
        execution_property: Optional[JobExecutionPropertyArgs] = None,
        glue_version: Optional[str] = None,
        job_mode: Optional[str] = None,
        job_run_queuing_enabled: Optional[bool] = None,
        allocated_capacity: Optional[float] = None,
        maintenance_window: Optional[str] = None,
        max_capacity: Optional[float] = None,
        default_arguments: Optional[Any] = None,
        name: Optional[str] = None,
        non_overridable_arguments: Optional[Any] = None,
        notification_property: Optional[JobNotificationPropertyArgs] = None,
        number_of_workers: Optional[int] = None,
        connections: Optional[JobConnectionsListArgs] = None,
        security_configuration: Optional[str] = None,
        tags: Optional[Any] = None,
        timeout: Optional[int] = None,
        worker_type: Optional[JobWorkerType] = None)
    func NewJob(ctx *Context, name string, args JobArgs, opts ...ResourceOption) (*Job, error)
    public Job(string name, JobArgs args, CustomResourceOptions? opts = null)
    public Job(String name, JobArgs args)
public Job(String name, JobArgs args, CustomResourceOptions options)

    type: aws-native:glue:Job
properties: # The arguments to resource properties.
options: # Bag of options to control resource's behavior.

    Parameters

    name string
    The unique name of the resource.
    args JobArgs
    The arguments to resource properties.
    opts CustomResourceOptions
    Bag of options to control resource's behavior.
    resource_name str
    The unique name of the resource.
    args JobArgs
    The arguments to resource properties.
    opts ResourceOptions
    Bag of options to control resource's behavior.
    ctx Context
    Context object for the current deployment.
    name string
    The unique name of the resource.
    args JobArgs
    The arguments to resource properties.
    opts ResourceOption
    Bag of options to control resource's behavior.
    name string
    The unique name of the resource.
    args JobArgs
    The arguments to resource properties.
    opts CustomResourceOptions
    Bag of options to control resource's behavior.
    name String
    The unique name of the resource.
    args JobArgs
    The arguments to resource properties.
    options CustomResourceOptions
    Bag of options to control resource's behavior.

    Job Resource Properties

    To learn more about resource properties and how to use them, see Inputs and Outputs in the Architecture and Concepts docs.

    Inputs

    In Python, inputs that are objects can be passed either as argument classes or as dictionary literals.

    The Job resource accepts the following input properties:

    Command Pulumi.AwsNative.Glue.Inputs.JobCommand
    The code that executes a job.
    Role string
    The name or Amazon Resource Name (ARN) of the IAM role associated with this job.
    AllocatedCapacity double
    The number of capacity units that are allocated to this job.
    Connections Pulumi.AwsNative.Glue.Inputs.JobConnectionsList
    Specifies the connections used by a job
    DefaultArguments object

    The default arguments for this job, specified as name-value pairs.

    Search the CloudFormation User Guide for AWS::Glue::Job for more information about the expected schema for this property.

    Description string
    A description of the job.
    ExecutionClass string
    Indicates whether the job is run with a standard or flexible execution class.
    ExecutionProperty Pulumi.AwsNative.Glue.Inputs.JobExecutionProperty
    The maximum number of concurrent runs that are allowed for this job.
    GlueVersion string
    Glue version determines the versions of Apache Spark and Python that AWS Glue supports.
    JobMode string
    Property description not available.
    JobRunQueuingEnabled bool
    Property description not available.
    LogUri string
    This field is reserved for future use.
    MaintenanceWindow string
    Property description not available.
    MaxCapacity double
    The number of AWS Glue data processing units (DPUs) that can be allocated when this job runs.
    MaxRetries double
    The maximum number of times to retry this job after a JobRun fails
    Name string
    The name you assign to the job definition
    NonOverridableArguments object

    Non-overridable arguments for this job, specified as name-value pairs.

    Search the CloudFormation User Guide for AWS::Glue::Job for more information about the expected schema for this property.

    NotificationProperty Pulumi.AwsNative.Glue.Inputs.JobNotificationProperty
    Specifies configuration properties of a notification.
    NumberOfWorkers int
    The number of workers of a defined workerType that are allocated when a job runs.
    SecurityConfiguration string
    The name of the SecurityConfiguration structure to be used with this job.
    Tags object

    The tags to use with this job.

    Search the CloudFormation User Guide for AWS::Glue::Job for more information about the expected schema for this property.

    Timeout int
    The maximum time that a job run can consume resources before it is terminated and enters TIMEOUT status.
    WorkerType Pulumi.AwsNative.Glue.JobWorkerType
    TThe type of predefined worker that is allocated when a job runs.
    Command JobCommandArgs
    The code that executes a job.
    Role string
    The name or Amazon Resource Name (ARN) of the IAM role associated with this job.
    AllocatedCapacity float64
    The number of capacity units that are allocated to this job.
    Connections JobConnectionsListArgs
    Specifies the connections used by a job
    DefaultArguments interface{}

    The default arguments for this job, specified as name-value pairs.

    Search the CloudFormation User Guide for AWS::Glue::Job for more information about the expected schema for this property.

    Description string
    A description of the job.
    ExecutionClass string
    Indicates whether the job is run with a standard or flexible execution class.
    ExecutionProperty JobExecutionPropertyArgs
    The maximum number of concurrent runs that are allowed for this job.
    GlueVersion string
    Glue version determines the versions of Apache Spark and Python that AWS Glue supports.
    JobMode string
    Property description not available.
    JobRunQueuingEnabled bool
    Property description not available.
    LogUri string
    This field is reserved for future use.
    MaintenanceWindow string
    Property description not available.
    MaxCapacity float64
    The number of AWS Glue data processing units (DPUs) that can be allocated when this job runs.
    MaxRetries float64
    The maximum number of times to retry this job after a JobRun fails
    Name string
    The name you assign to the job definition
    NonOverridableArguments interface{}

    Non-overridable arguments for this job, specified as name-value pairs.

    Search the CloudFormation User Guide for AWS::Glue::Job for more information about the expected schema for this property.

    NotificationProperty JobNotificationPropertyArgs
    Specifies configuration properties of a notification.
    NumberOfWorkers int
    The number of workers of a defined workerType that are allocated when a job runs.
    SecurityConfiguration string
    The name of the SecurityConfiguration structure to be used with this job.
    Tags interface{}

    The tags to use with this job.

    Search the CloudFormation User Guide for AWS::Glue::Job for more information about the expected schema for this property.

    Timeout int
    The maximum time that a job run can consume resources before it is terminated and enters TIMEOUT status.
    WorkerType JobWorkerType
    TThe type of predefined worker that is allocated when a job runs.
    command JobCommand
    The code that executes a job.
    role String
    The name or Amazon Resource Name (ARN) of the IAM role associated with this job.
    allocatedCapacity Double
    The number of capacity units that are allocated to this job.
    connections JobConnectionsList
    Specifies the connections used by a job
    defaultArguments Object

    The default arguments for this job, specified as name-value pairs.

    Search the CloudFormation User Guide for AWS::Glue::Job for more information about the expected schema for this property.

    description String
    A description of the job.
    executionClass String
    Indicates whether the job is run with a standard or flexible execution class.
    executionProperty JobExecutionProperty
    The maximum number of concurrent runs that are allowed for this job.
    glueVersion String
    Glue version determines the versions of Apache Spark and Python that AWS Glue supports.
    jobMode String
    Property description not available.
    jobRunQueuingEnabled Boolean
    Property description not available.
    logUri String
    This field is reserved for future use.
    maintenanceWindow String
    Property description not available.
    maxCapacity Double
    The number of AWS Glue data processing units (DPUs) that can be allocated when this job runs.
    maxRetries Double
    The maximum number of times to retry this job after a JobRun fails
    name String
    The name you assign to the job definition
    nonOverridableArguments Object

    Non-overridable arguments for this job, specified as name-value pairs.

    Search the CloudFormation User Guide for AWS::Glue::Job for more information about the expected schema for this property.

    notificationProperty JobNotificationProperty
    Specifies configuration properties of a notification.
    numberOfWorkers Integer
    The number of workers of a defined workerType that are allocated when a job runs.
    securityConfiguration String
    The name of the SecurityConfiguration structure to be used with this job.
    tags Object

    The tags to use with this job.

    Search the CloudFormation User Guide for AWS::Glue::Job for more information about the expected schema for this property.

    timeout Integer
    The maximum time that a job run can consume resources before it is terminated and enters TIMEOUT status.
    workerType JobWorkerType
    TThe type of predefined worker that is allocated when a job runs.
    command JobCommand
    The code that executes a job.
    role string
    The name or Amazon Resource Name (ARN) of the IAM role associated with this job.
    allocatedCapacity number
    The number of capacity units that are allocated to this job.
    connections JobConnectionsList
    Specifies the connections used by a job
    defaultArguments any

    The default arguments for this job, specified as name-value pairs.

    Search the CloudFormation User Guide for AWS::Glue::Job for more information about the expected schema for this property.

    description string
    A description of the job.
    executionClass string
    Indicates whether the job is run with a standard or flexible execution class.
    executionProperty JobExecutionProperty
    The maximum number of concurrent runs that are allowed for this job.
    glueVersion string
    Glue version determines the versions of Apache Spark and Python that AWS Glue supports.
    jobMode string
    Property description not available.
    jobRunQueuingEnabled boolean
    Property description not available.
    logUri string
    This field is reserved for future use.
    maintenanceWindow string
    Property description not available.
    maxCapacity number
    The number of AWS Glue data processing units (DPUs) that can be allocated when this job runs.
    maxRetries number
    The maximum number of times to retry this job after a JobRun fails
    name string
    The name you assign to the job definition
    nonOverridableArguments any

    Non-overridable arguments for this job, specified as name-value pairs.

    Search the CloudFormation User Guide for AWS::Glue::Job for more information about the expected schema for this property.

    notificationProperty JobNotificationProperty
    Specifies configuration properties of a notification.
    numberOfWorkers number
    The number of workers of a defined workerType that are allocated when a job runs.
    securityConfiguration string
    The name of the SecurityConfiguration structure to be used with this job.
    tags any

    The tags to use with this job.

    Search the CloudFormation User Guide for AWS::Glue::Job for more information about the expected schema for this property.

    timeout number
    The maximum time that a job run can consume resources before it is terminated and enters TIMEOUT status.
    workerType JobWorkerType
    TThe type of predefined worker that is allocated when a job runs.
    command JobCommandArgs
    The code that executes a job.
    role str
    The name or Amazon Resource Name (ARN) of the IAM role associated with this job.
    allocated_capacity float
    The number of capacity units that are allocated to this job.
    connections JobConnectionsListArgs
    Specifies the connections used by a job
    default_arguments Any

    The default arguments for this job, specified as name-value pairs.

    Search the CloudFormation User Guide for AWS::Glue::Job for more information about the expected schema for this property.

    description str
    A description of the job.
    execution_class str
    Indicates whether the job is run with a standard or flexible execution class.
    execution_property JobExecutionPropertyArgs
    The maximum number of concurrent runs that are allowed for this job.
    glue_version str
    Glue version determines the versions of Apache Spark and Python that AWS Glue supports.
    job_mode str
    Property description not available.
    job_run_queuing_enabled bool
    Property description not available.
    log_uri str
    This field is reserved for future use.
    maintenance_window str
    Property description not available.
    max_capacity float
    The number of AWS Glue data processing units (DPUs) that can be allocated when this job runs.
    max_retries float
    The maximum number of times to retry this job after a JobRun fails
    name str
    The name you assign to the job definition
    non_overridable_arguments Any

    Non-overridable arguments for this job, specified as name-value pairs.

    Search the CloudFormation User Guide for AWS::Glue::Job for more information about the expected schema for this property.

    notification_property JobNotificationPropertyArgs
    Specifies configuration properties of a notification.
    number_of_workers int
    The number of workers of a defined workerType that are allocated when a job runs.
    security_configuration str
    The name of the SecurityConfiguration structure to be used with this job.
    tags Any

    The tags to use with this job.

    Search the CloudFormation User Guide for AWS::Glue::Job for more information about the expected schema for this property.

    timeout int
    The maximum time that a job run can consume resources before it is terminated and enters TIMEOUT status.
    worker_type JobWorkerType
    TThe type of predefined worker that is allocated when a job runs.
    command Property Map
    The code that executes a job.
    role String
    The name or Amazon Resource Name (ARN) of the IAM role associated with this job.
    allocatedCapacity Number
    The number of capacity units that are allocated to this job.
    connections Property Map
    Specifies the connections used by a job
    defaultArguments Any

    The default arguments for this job, specified as name-value pairs.

    Search the CloudFormation User Guide for AWS::Glue::Job for more information about the expected schema for this property.

    description String
    A description of the job.
    executionClass String
    Indicates whether the job is run with a standard or flexible execution class.
    executionProperty Property Map
    The maximum number of concurrent runs that are allowed for this job.
    glueVersion String
    Glue version determines the versions of Apache Spark and Python that AWS Glue supports.
    jobMode String
    Property description not available.
    jobRunQueuingEnabled Boolean
    Property description not available.
    logUri String
    This field is reserved for future use.
    maintenanceWindow String
    Property description not available.
    maxCapacity Number
    The number of AWS Glue data processing units (DPUs) that can be allocated when this job runs.
    maxRetries Number
    The maximum number of times to retry this job after a JobRun fails
    name String
    The name you assign to the job definition
    nonOverridableArguments Any

    Non-overridable arguments for this job, specified as name-value pairs.

    Search the CloudFormation User Guide for AWS::Glue::Job for more information about the expected schema for this property.

    notificationProperty Property Map
    Specifies configuration properties of a notification.
    numberOfWorkers Number
    The number of workers of a defined workerType that are allocated when a job runs.
    securityConfiguration String
    The name of the SecurityConfiguration structure to be used with this job.
    tags Any

    The tags to use with this job.

    Search the CloudFormation User Guide for AWS::Glue::Job for more information about the expected schema for this property.

    timeout Number
    The maximum time that a job run can consume resources before it is terminated and enters TIMEOUT status.
    workerType "Standard" | "G.1X" | "G.2X" | "G.025X" | "G.4X" | "G.8X" | "Z.2X"
    TThe type of predefined worker that is allocated when a job runs.

    Outputs

    All input properties are implicitly available as output properties. Additionally, the Job resource produces the following output properties:

    Id string
    The provider-assigned unique ID for this managed resource.
    Id string
    The provider-assigned unique ID for this managed resource.
    id String
    The provider-assigned unique ID for this managed resource.
    id string
    The provider-assigned unique ID for this managed resource.
    id str
    The provider-assigned unique ID for this managed resource.
    id String
    The provider-assigned unique ID for this managed resource.

    Supporting Types

    JobCommand, JobCommandArgs

    Name string
    The name of the job command
    PythonVersion string
    The Python version being used to execute a Python shell job.
    Runtime string
    Runtime is used to specify the versions of Ray, Python and additional libraries available in your environment
    ScriptLocation string
    Specifies the Amazon Simple Storage Service (Amazon S3) path to a script that executes a job
    Name string
    The name of the job command
    PythonVersion string
    The Python version being used to execute a Python shell job.
    Runtime string
    Runtime is used to specify the versions of Ray, Python and additional libraries available in your environment
    ScriptLocation string
    Specifies the Amazon Simple Storage Service (Amazon S3) path to a script that executes a job
    name String
    The name of the job command
    pythonVersion String
    The Python version being used to execute a Python shell job.
    runtime String
    Runtime is used to specify the versions of Ray, Python and additional libraries available in your environment
    scriptLocation String
    Specifies the Amazon Simple Storage Service (Amazon S3) path to a script that executes a job
    name string
    The name of the job command
    pythonVersion string
    The Python version being used to execute a Python shell job.
    runtime string
    Runtime is used to specify the versions of Ray, Python and additional libraries available in your environment
    scriptLocation string
    Specifies the Amazon Simple Storage Service (Amazon S3) path to a script that executes a job
    name str
    The name of the job command
    python_version str
    The Python version being used to execute a Python shell job.
    runtime str
    Runtime is used to specify the versions of Ray, Python and additional libraries available in your environment
    script_location str
    Specifies the Amazon Simple Storage Service (Amazon S3) path to a script that executes a job
    name String
    The name of the job command
    pythonVersion String
    The Python version being used to execute a Python shell job.
    runtime String
    Runtime is used to specify the versions of Ray, Python and additional libraries available in your environment
    scriptLocation String
    Specifies the Amazon Simple Storage Service (Amazon S3) path to a script that executes a job

    JobConnectionsList, JobConnectionsListArgs

    Connections List<string>
    A list of connections used by the job.
    Connections []string
    A list of connections used by the job.
    connections List<String>
    A list of connections used by the job.
    connections string[]
    A list of connections used by the job.
    connections Sequence[str]
    A list of connections used by the job.
    connections List<String>
    A list of connections used by the job.

    JobExecutionProperty, JobExecutionPropertyArgs

    MaxConcurrentRuns double
    The maximum number of concurrent runs allowed for the job.
    MaxConcurrentRuns float64
    The maximum number of concurrent runs allowed for the job.
    maxConcurrentRuns Double
    The maximum number of concurrent runs allowed for the job.
    maxConcurrentRuns number
    The maximum number of concurrent runs allowed for the job.
    max_concurrent_runs float
    The maximum number of concurrent runs allowed for the job.
    maxConcurrentRuns Number
    The maximum number of concurrent runs allowed for the job.

    JobNotificationProperty, JobNotificationPropertyArgs

    NotifyDelayAfter int
    It is the number of minutes to wait before sending a job run delay notification after a job run starts
    NotifyDelayAfter int
    It is the number of minutes to wait before sending a job run delay notification after a job run starts
    notifyDelayAfter Integer
    It is the number of minutes to wait before sending a job run delay notification after a job run starts
    notifyDelayAfter number
    It is the number of minutes to wait before sending a job run delay notification after a job run starts
    notify_delay_after int
    It is the number of minutes to wait before sending a job run delay notification after a job run starts
    notifyDelayAfter Number
    It is the number of minutes to wait before sending a job run delay notification after a job run starts

    JobWorkerType, JobWorkerTypeArgs

    Standard
    Standard
    G1x
    G.1X
    G2x
    G.2X
    G025x
    G.025X
    G4x
    G.4X
    G8x
    G.8X
    Z2x
    Z.2X
    JobWorkerTypeStandard
    Standard
    JobWorkerTypeG1x
    G.1X
    JobWorkerTypeG2x
    G.2X
    JobWorkerTypeG025x
    G.025X
    JobWorkerTypeG4x
    G.4X
    JobWorkerTypeG8x
    G.8X
    JobWorkerTypeZ2x
    Z.2X
    Standard
    Standard
    G1x
    G.1X
    G2x
    G.2X
    G025x
    G.025X
    G4x
    G.4X
    G8x
    G.8X
    Z2x
    Z.2X
    Standard
    Standard
    G1x
    G.1X
    G2x
    G.2X
    G025x
    G.025X
    G4x
    G.4X
    G8x
    G.8X
    Z2x
    Z.2X
    STANDARD
    Standard
    G1X
    G.1X
    G2X
    G.2X
    G025X
    G.025X
    G4X
    G.4X
    G8X
    G.8X
    Z2X
    Z.2X
    "Standard"
    Standard
    "G.1X"
    G.1X
    "G.2X"
    G.2X
    "G.025X"
    G.025X
    "G.4X"
    G.4X
    "G.8X"
    G.8X
    "Z.2X"
    Z.2X

    Package Details

    Repository
    AWS Native pulumi/pulumi-aws-native
    License
    Apache-2.0
    aws-native logo

    We recommend new projects start with resources from the AWS provider.

    AWS Cloud Control v1.9.0 published on Monday, Nov 18, 2024 by Pulumi
    pulumi/pulumi-aws-native