Siri can be silenced by holding down the home button and then using the volume controls on the phone. The iPhone's volume is separate from this and will not be affected.