Scale instability or DRIFT can be caused by a few reasons.
One may be the stability of the internal electronics.
An internal voltage reference or the A to D converter may have short term noise or longer term drift.
With a precision voltmeter, specifications are usually stated for a cal period that can be a year.
Your scale, load cell or Force Balance, has a "voltmeter" inside.
Cheaper load cell scales may have an independent voltage source for the load cell and another for AtoD reference. Better scales will use a single stable reference for both. Load cell excitation and AtoD reference will thus be a fixed ratio, tracking electronic noise or environmental changes more closely. Reference voltage goes up a few ppm, excitation voltage goes up the same amount.
Your environment may cause drift due to temperature drift.
Air temperature is only part of the issue. If air temperature is different than the mass of the scale or bench/platform then heat will move to and from the scale. A bench that is 75F and an air temperature of 72F will likely cause drift as the bench tries to heat the scale and the air tries to cool it. A cold or hot nearby outside wall or floor will cause instability. Air drafts are seldom the same temperature as your scale's internal components. Body heat usually doesn't cause issues until you go beyond the milligram sensitivity level. The recent trend is to use a surface plate under your scale. Not a bad idea as it adds a massive amount of mass to the scale dampening vibration but it also works like a heatsink adding temperature stability to the scale.
Electrical power noise and fluctuation seems to be an issue with digital scales, even with the favorite FX120.
Figure out what devices are on the same breaker circuit as your scale. When I set up in the kitchen the microwave causes a lot of electrical noise in the power. I have to stop when I heat up my coffee

My current loading corner is close to my modem mounted on the wall plugged into the same power strip as my scales. Less than 5 feet from the scales.
Shutting the modem off, on, low or heavy usage on wifi, cell phone doesn't affect my scales (EJ-54D2, cheaper digital scales, or ER-182A). Power dips when the HVAC compressor starts but levels out after a few seconds.
Same with the electric hot water heater. Once every couple of hours, power dips for a few seconds.
An AC voltmeter on your scale circuit might be helpful in troubleshooting. Some power conditioners might actually make things worse. Voltage issues can have various frequencies. Ferrite core chokes can help with noise from a few kilohertz to many megahertz. A digital wall wart keeps line voltage out of the scale's power supply and most have some level of regulation. Internal regulation and filtering are common with precision lab voltmeters normally operated in close proximity to other instruments. Why is it a problem with a digital scale?
Static is a BIG problem when working with static sensitive plastics or gun powder. Static electricity pulls or pushes pretty much like a magnet. Fill your trickler with powder and it could take hours for the static to dissipate. Same for dumping a charge into a pan. You could also be charging things you handle. While it could look like DRIFT, it's actually external to the measuring circuit. Is your plastic draft shield causing reading drift?
Menu options should be explored for stability bandwidth and zero capture. Cheaper scales don't usually have options to change measuring parameters. The "Autozero" function is often misunderstood. IF you have options, try autozero OFF. Test your scale at a low but nonzero reading for stability and repeatability. A good check weight of a few grams, or even something that is fixed and stable can be used to evaluate drift. Most will spend hours developing and testing a load, but expect a precision reloading bench to be plug-n-play. Know what level of precision you can expect with a digital scale. Calibration @ full scale is almost useless. A 100 gram scale used to measure powder charges in the 2 to 3 gram range needs to be checked near the actual load most used. Test for zero stability (without autozero), or near zero if you can't turn it off, and check for linearity errors at weights you might use.
Even if you don't think you need extra digits beyond a milligram level, test your weighing process to BETTER than neded.