You are right , it should not be that hard to do.
Since you are now skilled at removing the drum , I suggest you pop the brake return springs off , release the anti rattle clips and let the shoes go free .
Now you can take the adjuster off the wheel cyl and disassemble it , clean the threads up , a little anti seize on the threads then put it all back together .
Should be good to go then .