Aws glue extra files py file successfully. You can't package any Python libraries as . py files and even sub-packages) automatically zipped so it is reachable in glue code as from business_logic. argv,['JOB_NAME','extra-files']) print "The extra file is: ", args['extra-files'] I get the following error: extra_files - (Optional) The Amazon S3 paths to additional files, such as configuration files that AWS Glue copies to the working directory of your script before executing it. One may skip May 3, 2024 · Configuring Log4J for Spark on AWS Glue. The extension need not be . egg file) Libraries should be packaged in . The --extra-files option cannot be used, because of a limitation on temporary copies of S3 data. Run Spark code Apr 4, 2025 · however if you create a spark script in AWS Glue, you need to instead pass the jar files in the job details --> advanced properties as a "job parameter" where the key is "extra-jars" and the value is the https jar file path. Aug 4, 2019 · I know this question is over 3 years old and AWS Glue has moved on, but you can currently determine the location of any --extra-files (for Python shell Glue Jobs) by looking at the OS environment variable EXTRA_FILES_DIR e. lfdg yebps ktnl rgvl uaewcbspe xobiin ttzny ray ffwrx zmux