Is normal tap water OK to use in my pillow? August 06, 2019 14:47 Yes. If you use well water, you might want to add a few drops of bleach to the pillow water. Related articles Can the pillow be washed? Which side of the pillow do I sleep on? How long can the water stay in my pillow before it needs to be changed? How much water should I use to start off? How do I fill my pillow?