Here are some good books for a New Muslim:

1.

Title: Important Lessons For The Muslim Ummah

Author: Shaykh Bin Baz

Translator: Khalid A. Al-Awadh

Reviser: Dr. Saleh as-Saleh

View / Download

2.

Title:  The Explanation Of The Fundamentals Of Islamic Belief

Author: Shaykh Ibn Uthaymeen

Translator: Dr. Saleh as-Saleh

View / Download 

3.

Title: This Is Islaam

Author: Shaykh Saalih Al-Shaykh

View / Download

4.

Title: Take Your Beliefs From The Qur’aan And Sunnah

Author: Muhammad Ibn Jameel Zainoo

Translator: Sameh Strauch

View / Download

There are more, but these are good beginning books.

Mentioned by

Faisal Ibn Abdul Qaadir Ibn Hassan
Abu Sulaymaan