I am working on a project where I am trying to move a data pipeline built in python / pandas onto an AWS Lambda instance so that I can periodically run it live and update a couple graphics on a project website I'm building.
I have built a docker file for the packages I'm using and am trying to upload it as a layer, however I am still running up against file size restrictions from AWS, no matter how lean I try to build my docker file I can't seem to get around it.
Has anyone run into this problem and were you able to figure out a way around it? Is this a dead end and should I be trying to look for a different solution entirely? Not sure if JS or some other tool might be a more suitable solution. I'm getting pretty burnt out on ...
I am working on a project where I am trying to move a data pipeline built in python / pandas onto an AWS Lambda instance so that I can periodically run it live and update a couple graphics on a project website I'm building.
I have built a docker file for the packages I'm using and am trying to upload it as a layer, however I am still running up against file size restrictions from AWS, no matter how lean I try to build my docker file I can't seem to get around it.
Has anyone run into this problem and were you able to figure out a way around it? Is this a dead end and should I be trying to look for a different solution entirely? Not sure if JS or some other tool might be a more suitable solution. I'm getting pretty burnt out on this and have been picking it up and putting it down for the last month or so with no tangible progress.