<font face="Arial, Verdana" size="2" style="font-size: 10pt;">My Start G-Code/End G-Code are the default ones (default start actually contains an M107)</font>
The M106 is exactly where you wrote it shouldn't be:
<font face="Arial, Verdana" size="2">G1 F1800 X110.800 Y82.241 E503.47252</font>
<font face="Arial, Verdana" size="2">M106 S255</font>
<font face="Arial, Verdana" size="2">;LAYER:-1</font>
<font face="Arial, Verdana" size="2">;RAFT</font>
<font face="Arial, Verdana" size="2">G0 F9600 X110.616 Y81.766 Z0.470</font>
<font face="Arial, Verdana" size="2">;TYPE:SUPPORT</font>
<font face="Arial, Verdana" size="2">G1 F4800 X98.717 Y69.867 E504.22811</font>
<font face="Arial, Verdana" size="2">
</font>
<font size="2">Is it maybe related to the fact that I am using a raft?</font>