I've recently taken over for someone who has left the business. They've created a single AWS Glue script that gets all data from the following endpoints,
Code: Select all
endpoints = ["contractors", "vendorOrders", "catalogs", "vendors", "invoices", "employees", "jobs",
"quotes", "sites", "setup/teams", "contractorInvoices", "jobWorkOrders", "jobCostCenters", "schedules"]Any suggestions on getting this to work without the issues of Memory?
Would you recommend splitting each Endpoint into it's own run (Excluding the hierarchical ones)
TIA
DEVELOPER CENTER