Yes, simply go to the Shipping tab when on the product edit page and you can set up different shipping for each product.
Please note: You still need to set a generic shipping cost in the shop settings for shipping to be set up correctly and for customers to purchase from you.