Matrix manipulations is one of the core tasks in the data mining business.
This application oriented book demonstrates that there are very powerful numerical linear algebra techniques for solving problems in data mining.
I can recommend this book as an excellent starting point for matrix methods and linear algebra concepts applied to data mining problems.