Only at the start?

I play goild wars fairly smoothly, When im one minute into a mission, I hardly notice any lag, But its when it loads the zones, Like to load North Wall, or Yaks, it takes 1-2 minutes (sometimes even 3 with yaks!) I dont know how to fix this, I was thinking it was my memory, but im not too sure.

Comp specs?

Generally this can be attributed to computers having too little RAM. We need the specs first so we can know for sure.

AMD Athlon XP 2.4 Ghz (Clocked to 2.6)
GEForce 4 (some generic version)(Saving for all-in-wonder)
1tb Hd (Only 200gig used, I might pirate all my HDTV movies :O)
256mb RAM (Oh shzt!)(Saving for 2gig)

Get more memory. That's your bottleneck. Just buy another 256Mb stick for now and that should clear up your issues.