### A Mathematical Rehab

Posted by Muhammad Alkarouri in mathematics on September 3, 2007

Ok. So the last post wasn’t very successful (I am not going to argue about the definition of successful here). My explanation of space wasn’t so good, because almost everything can be described as set with structure, according to mathematicians. Now I am probably irritating some Category Theory proponents as well. Oh well.

As a corrective remedy, I am going to spend some time in a mathematical rehab. You will be able to follow that here. I will probably start by using the spaces mentioned in that post to explain various mathematical concepts.

And, as for the definition of space, let’s just say that a space is a space because a mathematician says so. And I am happy that wikipedia is not that better from my post.

### Space

Posted by Muhammad Alkarouri in mathematics on July 8, 2007

Space for mathematicians is an interesting set. Or we can say a set with structure. Trying to get used to this concept, I am listing a few spaces, with some explanation, here. By the way, members of such sets are usually called points.

- Vector Space: members of such a space can be scaled and added. Here the definition is dependent on properties of the members.

- Topological Space: in this space points have neighbourhoods. Or, the topological space is a set on which a collection of open sets (closed under unions and finite intersections) is defined.
- State Space: This means different things to computer scientists, physicists, and control engineers. For control engineers, state space is the space in which members are tuples of state variables.
- Metric Space: a metric or distance is defined between members of such a space.

- Euclidean Space: for most of us, this is the space acquired by age eighteen.

Of course, there are many more spaces. I mean, if you are so inclined, you can look up Hilbert Space, Minkowski Space, Anti de Sitter Space, etc. Just remember, a space is a set you can talk about.

### Dimension is not easy

Posted by Muhammad Alkarouri in mathematics on April 30, 2007

Dimension is not easy to understand. At the turn of the century it was one of the major problems in mathematics to determine what dimension means and which properties it has. And since then the situation has become somewhat worse because mathematicians have come up with some ten different notions of dimension: topological dimension, Hausdorff dimension, fractal dimension, self-similarity dimension, box-counting dimension, capacity dimension, information dimension, Euclidean dimension, and more. They are all related. Some of them, however, make sense in certain situations, but not at all in others, where alternative definitions are more helpful. Sometimes they all make sense and are the same. Sometimes several make sense but do not agree. The details can be confusing even for a research mathematician.

### Normal Law of Errors

Posted by Muhammad Alkarouri in machine learning, mathematics on April 26, 2007

Everybody firmly believes in it because the mathematicians imagine it is a fact of observation, and observers that it is a theory of mathematics.

*Henri PoincarĂ©*

So, which is it? To apportion the blame, I suggest that the fact of observation be that “errors” are independent and identically distributed with finite variances. Observers may as well vote for Lyapunov’s set of conditions. I am sure that mathematicians are more than happy to shoulder the responsibility for the resulting Central Limit Theorem.

### Hello world!

Posted by Muhammad Alkarouri in admin on April 6, 2007

Hello, world. This is the start of a blog for me.

Why start a blog? Many reasons actually. Improving my writing skills. As a communication platform with other friends around the globe. Getting ideas which may or may not be useful out there. A tool for learning. Trying to get more used to basic Web 2.0 (or is it Web 1.1?) concepts before everyone gets to use Web .

I am impressed by the current group of machine learning blogs like Machine Learning (Theory) and Machine Learning Thoughts among others, and I am actually learning a lot from them. However, this will not be a single topic blog, and I will be touching on different dimensions of life. Categories will hopefully reveal some method in the resulting madness.

By the way, dimensions may crop up on any topic raised here, in a mathematical sense or otherwise. You’ve been warned.