In one embodiment, the present invention includes a hybrid device having a first die including a semiconductor device and a second die coupled to the first die, where the second die includes a magnetic structure. The first die may be a semiconductor substrate, while the second die may be a magnetic substrate, and the first die may be stacked on the second die, in one embodiment. Other embodiments are described and claimed.