I finally got my AI workflow to run without crashing for a whole week

Had this pipeline for generating product descriptions that kept dying after 200 rows. Tried a bunch of fixes but nothing stuck until I just broke it into smaller batches of 50. Ran 2,000 products through it this week without a single crash. Has anyone else had to dumb down their approach to make AI actually stable?

2 comments

2 Comments

kimdixon8d ago

Honestly, that's such a relief to hear I'm not the only one. I mean, it sounds crazy that you have to manually split things into smaller pieces just to keep the thing from falling over, but that's exactly where I ended up too. I tried so many fancy "solutions" online that were supposed to fix it, but in the end, just breaking my batch into chunks of 30 is what actually worked. It feels like a step backward, you know? Like, why can't these tools just handle a normal workload without me having to babysit them. But at least it's stable now, and 2,000 products is a huge win, so kudos for sticking with it.

-1

noraroberts8d ago

Kept banging my head against the wall trying to automate it all at once. Finally just gave up and started feeding it 50 at a time. Works fine now. Sometimes the simple fix is the only fix, even if it feels dumb.