ARM processors could find a start in Web servers, which are generally used for less critical activity. ARM-based chips could also be used in low-end servers sitting on shelves in offices, McCarron said.

Analysts have also pointed out that the ARM architecture has limitations that make the chip limited in scope for servers. The company's upcoming Cortex-A15 processor has a 32-bit design, while x86 chips such as Intel's latest Atom processors have 64-bit extensions.

On a recent earnings call, ARM CEO Warren East said the company would ultimately add 64-bit extensions to its processor, but that a sizeable chunk of the server market was already available with its current 32-bit designs as few server applications used 64-bit applications.

Norrod said that ARM is just one of the interesting storylines that have made the server market the most exciting since the earlier part of the past decade, when blade servers were being introduced in the market. Significant technological development and multiple demand drivers have led to new server designs and form factors, Norrod said.

"It got boring, but it's not boring anymore," Norrod said.