In this work, an adaptive vibration filter was designed for Micro Electro - Mechanical System (MEMS) based on low cost Inertial Measurement Unit (IMU). Designed IMU has ten degree freedom. It consists of three axis accelerometer, three axis gyroscope, three axis magnetometer and one axis barometric pressure sensor. All sensors are connected to Cortex M3 based microcontroller. Kalman Filter was used as sensor fusion algorithm. Although Kalman filter could overcome many noise sources, it could give undesirable output signal when sensors, which are combined with Kalman filter, were affected by simultaneously same noise like as vibration noise. So in order to overcome the vibration affection of IMU, an Adaptive Noise Canceller (ANC) was designed and implemented for the IMU. In addition, an experimental setup was built to compare the IMU output with and without ANC.