Very few linear vector filters are known for color images and this may be due to the lack of a mathematical framework. This paper explores some possible mathematical approaches to linear vector filtering, including hypercomplex numbers, and dot and cross products. It also considers the fundamental pixel level operations that must exist to make linear vector filtering possible.