1 Introduction

The hypothetical extensions of the Standard Model (SM) that accommodate a dynamical explanation of the mass and mixing hierarchies in the quark, lepton and neutrino sectors, are typically expected to contain many new interactions and states at high scales of the theory. In particular, additional scalar fields are required to break the high-scale (e.g. discrete or continuous family) symmetries, causing the formation of specific patterns in the fermion mass spectra across generations. The additional inert sectors, such as heavy right-handed neutrinos, are mandatory for see-saw type mechanisms of neutrino mass generation, and play a supplemental but important cosmological role in leptogenesis and also as candidates for DM. In practice, there are no strong constraints on how many additional heavy scalar singlet and vector-like fermion states could be added to the SM at the fundamental level, as they typically produce vanishing direct signatures in collider measurements, but may have indirect (e.g. via radiative corrections) signatures imprinted into the patterns of SM couplings and mass parameters.

Table 1 Scalars assignments under the \(SU_{3c}\times SU_{2L}\times U_{1Y}\times U_{1X}\times Z_{2}^{(1)}\times Z_{2}^{(2)}\) symmetry
Table 2 Quark assignments under the \(SU_{3c}\times SU_{2L}\times U_{1Y}\times U_{1X}\times Z_{2}^{(1)}\times Z_{2}^{(2)}\) symmetry

In general, additional states are required to explain specific patterns in the SM fermion spectra. For example, to address only the quark sector and to explain the Cabbibo-like structure of the quark mixing simultaneously with the hierarchies in the quark mass spectrum, the addition of a gauged \(U_{1X}\) or discrete family symmetry and few extra scalar fields seems to be enough (see Refs. [1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16]). Such models, although not necessarily excluded, may generically suffer from large Flavor-Changing Neutral Currents (FCNCs) and from non-observability of Higgs partners in the few-hundreds GeV mass range. In order to explain the lepton mass hierarchy together with the highly decoupled neutrino mass spectrum, even more additional inputs are required on top of the SM. Due to a large number of states, such theories quickly become cumbersome to deal with and to verify phenomenologically. Therefore, the search for a particular model capable of explaining all the fermion mass and mixing hierarchies in a dynamical and fully renormalizable way, while still having it simple enough for a straightforward phenomenological verification, becomes a challenging and demanding, but very important task for the model-building community.

In addition, models having an extended scalar and (or) fermion sector are motivated by the search of a theoretical explanation for the Lepton Universality Violation (LUV) recently observed by the LHCb experiments. A concise review of New Physics models aimed at explaining the LUV and their possible connection to DM is provided in Ref. [17]. Some theoretical explanations for the LUV are discussed in Refs. [18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47].

Table 3 Lepton charge assignments under the \(SU_{3c}\times SU_{2L}\times U_{1Y}\times U_{1X}\times Z_{2}^{(1)}\times Z_{2}^{(2)}\) symmetry

In Ref. [16] we have proposed such a possible candidate theory, capable of generating the SM fermion mass and mixing hierarchies via a sequential loop suppression mechanism, in terms of model parameters with no intrinsically imposed hierarchies between them. In this framework the only fermion that acquires its mass at tree level is the heavy top quark. Moderate and light quark masses are generated essentially at one- or two-loop level, respectively, while light active neutrinos become massive only via three-loop radiative seesaw mechanisms triggered after the electroweak symmetry breaking. We have found specific conditions on the minimal symmetry and particle content for a theory where this mechanism can be realized without adding the non-renormalizable (higher-dimensional) Yukawa operators or soft family-breaking mass terms. While such a construction is supposedly not unique, its minimality is manifest as every field plays a relevant role for producing the observed patterns in quark, lepton and neutrino sectors of the SM, with a required degree of suppression between the corresponding SM parameters.

2 Review of the extended IDM model

With the aim of generating the hierarchy of SM charged fermion masses via the sequential loop suppression mechanism, proposed for the first time in Ref. [7], we consider an extension of the inert two-Higgs doublet model (ITHDM), where the SM gauge symmetry is supplemented by an exactly preserved \(Z_{2}^{(2)}\) and spontaneously broken \(Z_{2}^{(1)}\) discrete groups, and by an \(U_{1X}\) gauge symmetry. The scalar sector of the ITHDM is extended to include seven electrically neutral fields, i.e., \( \sigma _{j}\) (\(j=1,2,3\)), \(\rho _{k}\) (\(k=1,2,3\)), \(\eta \) and five electrically charged \(\varphi _{k}^{+}\) (\(k=1,2,3,4,5\)) \(SU_{2L}\) scalar singlets. The fermion sector of the SM includes additionally six SM gauge-singlet charged leptons \(E_{jL}\) and \(E_{jR}\) (\(j=1,2,3\)), four right handed neutrinos \(\nu _{jR}\) (\(j=1,2,3\)), \(\Omega _{R}\) and twelve \(SU_{2L} \) singlet heavy quarks \(T_{L}\), \(T_{R}\), \({\widetilde{T}}_{L}\),\(\ {\widetilde{T}} _{R}\), \(B_{kL}\), \(B_{kR}\) (\(k=1,2,3,4\)). It is assumed that the heavy exotic T, \({\widetilde{T}}\) and \(B_{k}\) quarks have electric charges equal to \( \frac{2}{3}\) and \(-\frac{1}{3}\), respectively. The scalar, quark and lepton assignments under the \(SU_{3c}\times SU_{2L}\times U_{1Y}\times U_{1X}\times Z_{2}^{(1)}\times Z_{2}^{(2)}\) symmetry are shown in Tables 1, 2 and 3, respectively. It was shown in Ref. [7] that with this field content and the corresponding assignments the gauge anomaly cancellation conditions are satisfied in our model.

Let us note that the SM Higgs doublet, i.e., \(\phi _{1}\), as well as the SM scalar singlets \(\sigma _{1}\) and \(\rho _{3}\) are the only scalar fields neutral under the preserved \(Z_{2}^{(2)}\) discrete symmetry. Since the \( Z_{2}^{(2)}\) symmetry remains unbroken, the SM Higgs doublet \(\phi _{1}\) and the SM scalar singlets \(\sigma _{1}\) and \(\rho _{3}\) are the only scalar fields which acquire nonvanishing vacuum expectation values. The SM scalar singlet \(\sigma _{1}\) is required to spontaneously break the \(U_{1X}\) local symmetry, whereas the scalar singlet \(\rho _{3}\) spontaneously breaks the \( Z_{2}^{(1)}\) discrete symmetry, due to its nontrivial \(Z_{2}^{(1)}\) charge.

In the following we provide a brief justification for introducing different particles in our model. It is worth mentioning that the set of \(SU_{2L}\) -singlet heavy quarks \(T_{L}\), \(T_{R}\), \(B_{iL}\), \(B_{iR}\) (\(i=1,2,3\)) represents the minimal amount of exotic quark degrees of freedom needed to implement the one-loop radiative seesaw mechanism that gives rise to the charm, bottom and strange quark masses. In addition, to implement this one-loop radiative seesaw mechanism, one needs the extra \(\phi _{2}\) scalar doublet, the gauge singlet scalars \(\rho _{2}\), \(\rho _{3}\) and \(\eta \), charged under the preserved \(Z_{2}^{(2)}\) symmetry as well as the scalar singlets \(\sigma _{1}\) and \(\rho _{3}\) that spontaneously break the \(U_{1X}\) and \(Z_{2}^{(1)}\) symmetries, respectively. Furthermore, in order to ensure the radiative seesaw mechanism responsible for the generation of the up and down quark masses at two-loop level, the \(SU_{2L}\) singlet heavy quarks \( {\widetilde{T}}_{L}\), \({\widetilde{T}}_{R}\), \(B_{4L}\), \(B_{4R}\), as well as the electrically neutral, \(\sigma _{3}\), \(\rho _{2}\), and electrically charged, \( \varphi _{1}^{+}\), \(\varphi _{2}^{+}\) scalar \(SU_{2L}\)-singlets should also be present in the particle spectrum. Furthermore, the generation of one-loop tau and muon masses is mediated by the electrically charged weak-singlet leptons \(E_{rL}\) and \(E_{rR}\) (\(r=2,3\)), by the inert scalar \(SU_{2L}\) -doublet, \(\phi _{2}\), and by the \(SU_{2L}\)-singlets \(\sigma _{2}\), \(\rho _{1}\). On the other hand, to induce a non-zero electron mass at two-loop level, and extra weak-singlet charged \(E_{1}\) and neutral \(\nu _{mR}\) (\(m=1,3 \)), leptons \(\Psi _{R}\) as well as the electrically charged scalar singlets \(\varphi _{1}^{\pm }\), \(\varphi _{k}^{\pm }\) (\(k=3,4,5\)) would be required for this purpose. Moreover, the three-loop radiative seesaw mechanism responsible for the generation of the light active neutrino masses is mediated by the right-handed neutrinos \(\nu _{jR}\) (\(j=1,2,3\)), \(\Omega _{R}\), as well as by the inert scalar \(SU_{2L}\) doublet \(\phi _{2}\) and the \( SU_{2L}\)-singlet \(\sigma _{2}\). More details for the choice of the aforementioned particle content and symmetries are provided in our previous work in Ref. [16].

Fig. 1
figure 1

Some of the one-, two- and three-loop Feynman diagrams contributing to the entries of the SM fermion mass matrices. Here, \(n,m=1,2\), \(l,n=1,3\)

With the above specified particle content, the following Yukawa interactions and exotic fermion mass terms are present at renormalizable level, invariant under the \(SU_{3c}\times SU_{2L}\times U_{1Y}\times U_{1X}\times Z_{2}^{(1)}\times Z_{2}^{(2)}\) symmetry:

$$\begin{aligned} \mathcal {L}_{\mathrm {F}}= & {} y_{3j}^{\left( u\right) }{\overline{q}}_{3L} {\widetilde{\phi }}_{1}u_{3R}+\sum _{n=1}^{2}x_{n}^{\left( u\right) }\overline{q }_{nL}{\widetilde{\phi }}_{2}T_{R}+\sum _{n=1}^{2}z_{j}^{\left( u\right) } {\overline{T}}_{L}\eta ^{*}u_{nR} \nonumber \\&+y_{T}{\overline{T}}_{L}\sigma _{1}T_{R}+m_{ {\widetilde{T}}}{\overline{\widetilde{T}}}_{L}{\widetilde{T}}_{R}+x^{\left( T\right) }{\overline{T}}_{L}\rho _{2}{\widetilde{T}}_{R} \nonumber \\&+\sum _{n=1}^{2}x_{n}^{\left( d\right) }{\overline{q}}_{3L}\phi _{2}B_{nR}+\sum _{n=1}^{2}\sum _{j=1}^{3}y_{nj}^{\left( d\right) }{\overline{B}} _{nL}\eta d_{jR} \nonumber \\&+\sum _{j=1}^{3}z_{j}^{\left( d\right) }{\overline{B}}_{3L}\eta ^{*}d_{jR}+\sum _{n=1}^{2}w_{n}^{\left( u\right) }{\overline{B}} _{4L}\varphi _{1}^{-}u_{nR} \nonumber \\&+\sum _{k=3}^{4}m_{B_{k}}{\overline{B}}_{kL}B_{kR}+\sum _{n=1}^{2}x_{n}^{ \left( d\right) }{\overline{q}}_{nL}\phi _{2}B_{3R}\nonumber \\&+\sum _{n=1}^{2}\sum _{m=1}^{2}y_{nm}^{\left( B\right) }{\overline{B}} _{nL}\sigma _{1}^{*}B_{mR}+z^{\left( B\right) }{\overline{B}}_{3L}\sigma _{2}^{*}B_{4R}\nonumber \\&+\sum _{j=1}^{3}w_{j}^{\left( d\right) }\overline{ {\widetilde{T}}}_{L}\varphi _{2}^{+}d_{jR} \nonumber \\&+\sum _{k=1,3}x_{k3}^{\left( l\right) }{\overline{l}}_{kL}\phi _{2}E_{3R}\nonumber \\&+\sum _{k=1,3}y_{3k}^{\left( l\right) }{\overline{E}}_{3L}\rho _{1}l_{kR}+x_{22}^{\left( l\right) }{\overline{l}}_{2L}\phi _{2}E_{2R}+y_{22}^{\left( l\right) }{\overline{E}}_{2L}\rho _{1}l_{2R} \nonumber \\&+\sum _{i=1}^{3}y_{i}^{\left( E\right) }{\overline{E}}_{iL}\sigma _{1}^{*}E_{iR}+x_{2}^{\left( \nu \right) }{\overline{l}}_{2L}{\widetilde{\phi }}_{2}\nu _{2R}\nonumber \\&+\sum _{k=1,3}z_{k}^{\left( l\right) }\overline{\Psi _{R}^{C}}\varphi _{3}^{+}l_{kR}+\sum _{k=1,3}z_{k}^{\left( \nu \right) }{\overline{E}} _{1L}\varphi _{1}^{-}\nu _{kR}\nonumber \\&+z^{\left( E\right) }\overline{\Psi _{R}^{C}} \varphi _{4}^{+}E_{1R} +\sum _{k=1,3}\sum _{n=1,3}x_{kn}^{\left( \nu \right) }{\overline{l}}_{kL} {\widetilde{\phi }}_{2}\nu _{nR}\nonumber \\&+\sum _{k=1,3}y_{k}^{\left( \Omega \right) } \overline{\Omega _{1R}^{C}}\eta ^{*}\nu _{kR}+y^{\left( \Omega \right) } \overline{\Omega _{1R}^{C}}\sigma _{3}^{*}\nu _{2R} \nonumber \\&+x_{1}^{\left( \Psi \right) }\overline{\Omega _{1R}^{C}}\eta \Psi _{R}+x_{2}^{\left( \Psi \right) }\overline{\Omega _{2R}^{C}}\eta ^{*}\Psi _{R}+z_{\Omega }\overline{\Omega _{1R}^{C}}\sigma _{2}^{*}\Omega _{2R}\nonumber \\&+m_{\Psi }\overline{\Psi _{R}^{C}}\Psi _{R}+h.c., \end{aligned}$$
(1)

where the dimensionless couplings are \({\mathcal {O}}(1)\) parameters. From the quark Yukawa terms it follows that the top quark mass only arises from the interaction with the SM Higgs doublet \(\phi _{1}\). After the spontaneous breaking of the SM electroweak symmetry, the observed hierarchy of SM fermion masses arises by a sequential loop suppression, such that we have: tree-level top quark mass; one-loop bottom, strange, charm, tau and muon masses; two-loop masses for the up, down quarks as well as for the electron. Furthermore, light active neutrinos get their masses from a three-loop level radiative seesaw mechanism. Some of the one-, two- and three-loop Feynman diagrams contributing to the entries of the SM fermion mass matrices are shown in Fig. 1. More details are given in our previous work.

3 Constraints on the \(Z^{\prime }\) mass, couplings and production at the LHC

In this section, we discuss the constraints on the \(Z^{\prime }\) mass and couplings in our model that emerge due to the \(2.6\sigma \) lepton universality anomaly expressed as the ratio \(R_{K}=\frac{Br\left( B\rightarrow K\mu ^{+}\mu ^{-}\right) }{Br\left( B\rightarrow Ke^{+}e^{-}\right) }\) measured by the LHCb collaboration. In addition, we will determine the LEP constraint on the \(M_{Z^{\prime }}/g_{X}\) ratio. As we will show below, in our model the lepton universality violation is a consequence of the non-universal \(U_{1X}\) charge assignments of the fermionic fields. From the \(U_{1X}\) assignments for fermions, we find the following \(Z^{\prime }\) interactions with the SM fermions:

$$\begin{aligned} \mathcal {L}_{Z`}= & {} g_{X}{\overline{q}}_{3L}\gamma ^{\mu }q_{3L}Z_{\mu }^{\prime }+2g_{X}\sum _{j=1}^{3}{\overline{u}}_{jR}\gamma ^{\mu }u_{jR}Z_{\mu }^{\prime }\nonumber \\&- g_{X}\sum _{j=1}^{3}{\overline{d}}_{jR}\gamma ^{\mu }d_{jR}Z_{\mu }^{\prime } \nonumber \\&-3g_{X}{\overline{l}}_{2L}\gamma ^{\mu }l_{2L}Z_{\mu }^{\prime }-6g_{X} {\overline{l}}_{2R}\gamma ^{\mu }l_{2R}Z_{\mu }^{\prime }\nonumber \\&-3g_{X}\sum _{k=1,3} {\overline{l}}_{kR}\gamma ^{\mu }l_{kR}Z_{\mu }^{\prime }. \end{aligned}$$
(2)

Then the non-universal \(Z^{\prime }\) interactions with the SM fermions given above lead to the following effective Hamiltonian, where the fermionic fields are given in the physical basis:

$$\begin{aligned}&\Delta H_{eff} \nonumber \\&\quad =-\frac{g_{X}^{2}}{M_{Z^{\prime }}^{2}}\left( V_{DL}^{*}\right) _{32}\left( V_{DL}\right) _{33}x_{q_{3L}}\nonumber \\&\qquad \times \sum _{j=1}^{3}\left[ x_{l_{jL}}\left( {\overline{s}}\gamma ^{\mu }P_{L}b\right) \left( {\overline{l}} _{jL}\gamma ^{\mu }l_{jL}\right) \right. \nonumber \\&\qquad \left. +x_{l_{jR}}\left( {\overline{s}}\gamma ^{\mu } P_{L}b\right) \left( {\overline{l}}_{jR}\gamma ^{\mu }l_{jR}\right) \right] \nonumber \\&\quad =-\frac{g_{X}^{2}}{M_{Z^{\prime }}^{2}}\left( V_{DL}^{*}\right) _{32}\left( V_{DL}\right) _{33}\left[ -3\left( {\overline{s}}\gamma ^{\mu } P_{L}b\right) \left( {\overline{l}}_{2L}\gamma ^{\mu }l_{2L}\right) \right. \nonumber \\&\qquad -6\left( {\overline{s}}\gamma ^{\mu }P_{L}b\right) \left( {\overline{l}} _{2R}\gamma ^{\mu } l_{2R}\right) \nonumber \\&\qquad -\left. 3\left( {\overline{s}}\gamma ^{\mu }P_{L}b\right) \left( {\overline{l}} _{1R}\gamma ^{\mu }l_{1R}\right) \right. \nonumber \\&\qquad \left. -3\left( {\overline{s}}\gamma ^{\mu } P_{L}b\right) \left( {\overline{l}}_{3R}\gamma ^{\mu }l_{3R}\right) \right] \nonumber \\&\qquad \supset \frac{9g_{X}^{2}}{2M_{Z^{\prime }}^{2}}\left( V_{DL}^{*}\right) _{32}\left( V_{DL}\right) _{33}\left( {\overline{s}}\gamma ^{\mu } P_{L}b\right) \left( {\overline{\mu }}\gamma ^{\mu }\mu \right) , \end{aligned}$$
(3)

where the following relations have been taken into account:

$$\begin{aligned}&{\widetilde{M}}_{f} =\left( M_{f}\right) _{diag}=V_{fL}^{\dagger }M_{f}V_{fR}, \nonumber \\&f_{\left( L,R\right) }=V_{f\left( L,R\right) } {\widetilde{f}}_{\left( L,R\right) }, \nonumber \\&{\overline{f}}_{iL}\left( M_{f}\right) _{ij}f_{jR} ={\overline{\widetilde{f}}} _{kL}\left( V_{fL}^{\dagger }\right) _{ki}\left( M_{f}\right) _{ij} \left( V_{fR}\right) _{jl}{\widetilde{f}}_{lR} \nonumber \\&\quad ={\overline{\widetilde{f}}} _{kL}\left( V_{fL}^{\dagger }M_{f}V_{fR}\right) _{kl}{\widetilde{f}}_{lR}\nonumber \\&\quad = {\overline{\widetilde{f}}}_{kL}\left( {\widetilde{M}}_{f}\right) _{kl}\widetilde{ f}_{lR}=m_{fk}{\overline{\widetilde{f}}}_{kL}{\widetilde{f}}_{kR}, \nonumber \\&\qquad k =1,2,3. \end{aligned}$$
(4)

Here, \({\widetilde{f}}_{k\left( L,R\right) }\) and \(f_{k\left( L,R\right) }\) (\( k=1,2,3\)) are the SM fermionic fields in the mass and interaction bases, respectively.

Let us note that the \(R_{K}\) anomaly results from a shift in the Wilson coefficient \(C_{9}^{\mu \mu }\) appearing in the following \(\Delta B=1\) effective Hamiltonian:

$$\begin{aligned} \Delta H_{eff}=-\frac{G_{F}\alpha _{em}V_{tb}V_{ts}^{*}}{\sqrt{2}\pi } \sum _{{\widetilde{l}}=e,\mu ,\tau }C_{9}^{{\widetilde{l}}{\widetilde{l}}}\left( {\overline{s}}\gamma ^{\mu }P_{L}b\right) \left( {\overline{\widetilde{l}}} \gamma ^{\mu }{\widetilde{l}}\right) .\nonumber \\ \end{aligned}$$
(5)

Then, our model predicts the following correction to the \(C_{9}^{\mu \mu }\) coefficient relative to its SM value:

$$\begin{aligned} \Delta C_{9}^{\mu \mu }= & {} -\frac{9g_{X}^{2}}{2M_{Z^{\prime }}^{2}}\left( V_{DL}^{*}\right) _{32}\left( V_{DL}\right) _{33}\frac{\sqrt{2}\pi }{ G_{F}\alpha _{em}V_{tb}V_{ts}^{*}} \nonumber \\&\simeq -\frac{9g_{X}^{2}}{ 2M_{Z^{\prime }}^{2}}\frac{\sqrt{2}\pi }{G_{F}\alpha _{em}}. \end{aligned}$$
(6)

On the other hand, the LHCb data provide the constraints on the \( C_{9}^{\mu \mu }\) coefficient given in Table 4. Requiring for the correction to the \(C_{9}^{\mu \mu }\) coefficient predicted by our model to be inside the \(1\sigma \) and \(2\sigma \) experimentally allowed ranges, we find the constraints for the \(M_{Z^{\prime }}/g_{X}\) ratio:

$$\begin{aligned}&14\;\text{ TeV }<\frac{M_{Z^{\prime }}}{g_{X}}<20\;\text{ TeV }\;\; \text{ at } \text{1 } \sigma , \nonumber \\&13\;\text{ TeV }<\frac{M_{Z^{\prime }}}{g_{X}} <26\; \text{ TeV }\;\; \text{ at } \text{2 }\sigma . \end{aligned}$$
(7)
Table 4 Constraints on the \(C_{9}^{\mu \mu }\) Wilson coefficient from the LHCb data. Taken from Ref. [48]

With respect to the LEP bounds on the \(M_{Z^{\prime }}/g_{X}\) ratio, it is worth mentioning that the tightest constraint arises from the \( e^{+}e^{-}\rightarrow \mu ^{+}\mu ^{-}\) measurement at LEP. Using the effective leptonic interactions

$$\begin{aligned} \mathcal {L}_{eff}= & {} -\frac{g_{X}^{2}}{M_{Z^{\prime }}^{2}}\sum _{j=1}^{3} \left[ x_{l_{1L}}x_{l_{jL}}\left( {\overline{l}}_{1}\gamma ^{\mu }P_{L}l_{1}\right) \left( {\overline{l}}_{jL}\gamma ^{\mu }l_{jL}\right) \right. \nonumber \\&\left. +x_{l_{1L}}x_{l_{jR}}\left( {\overline{l}}_{1}\gamma ^{\mu }P_{L}l_{1}\right) \left( {\overline{l}}_{jR}\gamma ^{\mu }l_{jR}\right) \right] \nonumber \\&-\frac{g_{X}^{2}}{M_{Z^{\prime }}^{2}}\sum _{j=1}^{3}\left[ x_{l_{1R}}x_{l_{jL}}\left( {\overline{l}}_{1}\gamma ^{\mu }P_{R}l_{1}\right) \left( {\overline{l}}_{jL}\gamma ^{\mu }l_{jL}\right) \right. \nonumber \\&\left. +x_{l_{1R}}x_{l_{jR}}\left( {\overline{l}}_{1}\gamma ^{\mu }P_{R}l_{1}\right) \left( {\overline{l}}_{jR}\gamma ^{\mu }l_{jR}\right) \right] , \end{aligned}$$
(8)

we find that the \(e^{+}e^{-}\rightarrow \mu ^{+}\mu ^{-}\) measurement at LEP imposes the following limit [51]:

$$\begin{aligned} \frac{2M_{Z^{\prime }}}{g_{X}\sqrt{ x_{l_{1L}}x_{l_{2L}}+x_{l_{1R}}x_{l_{2R}}+x_{l_{1R}}x_{l_{2L}}+x_{l_{1L}}x_{l_{2R}} }} > 4.6\;\text{ TeV },\nonumber \\ \end{aligned}$$
(9)

which for the leptonic charge assignments of our model takes the form:

$$\begin{aligned} \frac{2M_{Z^{\prime }}}{3\sqrt{3}g_{X}}\simeq 0.38\frac{M_{Z^{\prime }}}{ g_{X}}>4.6\;\text{ TeV }. \end{aligned}$$
(10)

The latter yields the following lower bound on the \(M_{Z^{\prime }}/g_{X}\) ratio:

$$\begin{aligned} \frac{M_{Z^{\prime }}}{g_{X}}>12 \;\text{ TeV }. \end{aligned}$$
(11)

In what follows, we proceed with computing the total cross section for production of a heavy \(Z^{\prime }\) gauge boson at the LHC via a Drell–Yan (DY) mechanism. In this computation, we consider the dominant contribution due to the parton distribution functions of the light up, down and strange quarks, so that the total \(Z^{\prime }\) production cross section via quark-antiquark annihilation in proton-proton collisions with center-of-mass energy \(\sqrt{S}\) reads:

$$\begin{aligned}&\sigma _{pp\rightarrow Z^{\prime }}^{\mathrm {DY}}\left( S\right) =\frac{ g^{2}\pi }{6c_{W}^{2}S}\left\{ 4g_{X}^{2}\int _{\ln \sqrt{\frac{ M_{Z^{\prime }}^{2}}{S}}}^{-\ln \sqrt{\frac{M_{Z^{\prime }}^{2}}{S}} }\right. \nonumber \\&\quad f_{p/u}\left( \sqrt{ \frac{M_{Z^{\prime }}^{2}}{S}}e^{y},\mu ^{2}\right) f_{p/{\overline{u}}}\left( \sqrt{\frac{M_{Z^{\prime }}^{2}}{S}}e^{-y},\mu ^{2}\right) dy \nonumber \\&\quad + g_{X}^{2}\int _{\ln \sqrt{\frac{M_{Z^{\prime }}^{2}}{S}}}^{-\ln \sqrt{\frac{M_{Z^{\prime }}^{2}}{S}}}f_{p/d}\left( \sqrt{\frac{M_{Z^{\prime }}^{2}}{S}}e^{y},\mu ^{2}\right) \nonumber \\&\quad \times f_{p/{\overline{d}}}\left( \sqrt{\frac{ M_{Z^{\prime }}^{2}}{S}}e^{-y},\mu ^{2}\right) dy + g_{X}^{2}\int _{\ln \sqrt{\frac{M_{Z^{\prime }}^{2}}{S}}}^{-\ln \sqrt{\frac{M_{Z^{\prime }}^{2}}{S}}}\nonumber \\&\left. \quad \times f_{p/s}\left( \sqrt{\frac{M_{Z^{\prime }}^{2}}{S}}e^{y},\mu ^{2}\right) f_{p/{\overline{s}}}\left( \sqrt{\frac{ M_{Z^{\prime }}^{2}}{S}}e^{-y},\mu ^{2}\right) dy\right\} ,\nonumber \\ \end{aligned}$$
(12)

where \(f_{p/u}\left( x_1,\mu ^2 \right) \) (\(f_{p/{\overline{u}}}\left( x_2,\mu ^2 \right) \)), \(f_{p/d}\left( x_1,\mu ^2 \right) \) (\(f_{p/{\overline{d}}}\left( x_2,\mu ^2 \right) \)) and \(f_{p/s}\left( x_1,\mu ^2 \right) \) (\(f_{p/\overline{s }}\left( x_2,\mu ^2 \right) \)) are the distributions of the light up, down and strange quarks (antiquarks) in the proton, respectively, which carry momentum fractions \(x_1\) (\(x_2\)) of the proton. Here, \(\mu =m_{Z^\prime }\) is the corresponding factorization scale.

Fig. 2
figure 2

The total \(Z^{\prime }\) production cross section via the DY mechanism at the LHC for \(\sqrt{S}=13\) TeV and \(g_{X}=0.1\) as a function of the \(Z^{\prime }\) mass

Figure 2 displays the total \(Z^{\prime }\) production cross section via the DY mechanism at the LHC for \(\sqrt{S}=13\) TeV and \(g_{X}=0.1\) as a function of the \(Z^{\prime }\) mass. The latter is varied from 1.4 up to 2 TeV to satisfy the LEP constraint as well as the constraints imposed by the \(2.6\sigma \) anomaly in lepton universality. For such as a region of \(Z^{\prime }\) masses, we find that the total production cross section is found to be 0.2–1 pb. On the other hand, at a future 100 TeV proton-proton collider this cross section gets significantly enhanced reaching values of 9–29 pb in the same mass interval, as indicated in Fig. 3. Note that the dominant \(Z^{\prime }\) production channel in pp collisions is via the Drell–Yan process \(q{{\bar{q}}}\rightarrow Z^{\prime }\), \(q=u,d,s\) (for the production cross section see Eq. (12)). The produced \(Z^{\prime }\) then can decay into a leptonic pair \(Z^{\prime }\rightarrow l{{\bar{l}}}\) which is a standard search channel for \(Z^{\prime }\) at the LHC. Non-observation of such a decay channel at LEP-II yields the lower bound \(M_{^{\prime }}/g_X > 12\) TeV (see Eq. (11)). The hadron collider observables of \(Z^{\prime }\) in hadronic and leptonic channels in the current model requires a dedicated analysis of the experimental bounds in each of the \(Z^{\prime }\) decay channels, and should be left for future studies.

Fig. 3
figure 3

The total \(Z^{\prime }\) production cross section via the DY mechanism at a future pp collider for \(\sqrt{S}=100\) TeV and \( g_{X}=0.1\) as a function of the \(Z^{\prime }\) mass

Finally, to close this section, we justify why our model is safe against Flavor Changing Neutral Currents (FCNCs) constraints. Since the model contains two electroweak doublet Higgs scalars \(\phi _{1,2}\) we are required to take special care of this issue. Our model automatically implements the alignment limit for the lightest 125 GeV Higgs boson, because all other scalar states decouple in the mass spectrum and, hence, are very heavy by default. This means the SM-like Higgs boson does not have tree-level FCNCs while such contributions from the heavier scalars are strongly suppressed by their large mass scale. While a detailed study of the FCNC constraints goes beyond the scope of the present work, we can resort to the Glashow–Weinberg–Paschos the theorem [49, 50] in order to justify nonexistence of FCNCs in our model. This theorem states that there will be no tree-level FCNC coming from the scalar sector, if all right-handed fermions of a given electric charge couple to only one of the doublets. As seen from Eq. (1) this condition is satisfied in our model. So, despite of an obvious mass suppression, any possible FCNC corrections would emerge at a loop level only, guarantying the model to be safe with respect to the corresponding phenomenological constraints. Finally, any possible FCNC from the \(Z'\) mediation would be strongly suppressed by its large mass scale compared to the EW one, i.e. \(m_{Z'} >12\) TeV (for \(g_X=1\)), according to the LEP constraint.

Fig. 4
figure 4

Loop Feynman diagrams contributing to the muon anomalous magnetic moment. Here \(k=1,2\)

4 Muon anomalous magnetic moment

In this section, we will determine the constraints on the parameter space of our model imposed by the experimental measurements of the muon anomalous magnetic moment. The latter receives one-loop contributions from vertex diagrams involving the \(Z^{\prime }\) exchange as well as the exchanges of the heavy \(Z_{2}^{\left( 2\right) }\) charged neutral scalars \({\text {Re}} \left( \rho _{1}\right) \), \({\text {Re}}\left( \phi _{2}^{0}\right) \), \({\text {Im }}\left( \phi _{2}^{0}\right) \), \({\text {Im}}\left( \rho _{1}\right) \), that couple to the charged exotic lepton \(E_{2}\). The Loop Feynman diagrams contributing to the muon anomalous magnetic moment is shown in Figure 4. The scalar contributions to the muon anomalous magnetic moment include the Yukawa interactions \({\overline{E}} _{2L}\rho _{1}l_{2R}\) and \({\overline{l}}_{2L}\phi _{2}E_{2R}\) as well as the trilinear scalar interactions such as \(\rho _{2}\left( \phi _{1}\cdot \phi _{2}^{\dagger }\right) \sigma _{1}^{*}\) giving rise to the \(\phi _{2}^{0} \)\(\rho _{2}\) mixing, which is crucial to generate those contributions.

In view of a huge amount of free parameters in the scalar potential of our model (which is shown explicitly in our previous work in Ref. [16]), for the sake of simplicity, here we work with a simplified benchmark scenario where \({\text {Re}}\left( \rho _{1}\right) \) (\( {\text {Im}}\left( \rho _{1}\right) \)) and \({\text {Re}}\left( \phi _{2}^{0}\right) \) (\({\text {Im}}\left( \phi _{2}^{0}\right) \)) mix between themselves only and do not mix with other scalar fields. In this scenario, we have the following relations:

$$\begin{aligned} \left( \begin{array}{c} H_{1} \\ H_{2} \end{array} \right)= & {} \left( \begin{array}{cc} \cos \theta _{S} &{} \sin \theta _{S} \\ -\sin \theta _{S} &{} \cos \theta _{S} \end{array} \right) \left( \begin{array}{c} {\text {Re}}\left( \rho _{1}\right) \\ {\text {Re}}\left( \phi _{2}^{0}\right) \end{array} \right) , \nonumber \\ \left( \begin{array}{c} A_{1} \\ A_{2} \end{array} \right)= & {} \left( \begin{array}{cc} \cos \theta _{P} &{} \sin \theta _{P} \\ -\sin \theta _{P} &{} \cos \theta _{P} \end{array} \right) \left( \begin{array}{c} {\text {Im}}\left( \rho _{1}\right) \\ {\text {Im}}\left( \phi _{2}^{0}\right) \end{array} \right) , \end{aligned}$$
(13)

where \(H_{1}\), \(H_{2}\) are the physical CP-even scalars whereas \(A_{1}\) and \( A_{2}\) are the CP-odd scalars in the physical basis. In addition, without any loss of generality we set \(\theta _{S}=\theta _{P}=\theta \) and \( y_{22}^{\left( l\right) }=x_{22}^{\left( l\right) }=y\). Then, the muon anomalous magnetic moment in this scenario reads:

$$\begin{aligned} \Delta a_{\mu }= & {} y^{2}\frac{m_{\mu }^{2}}{8\pi ^{2}}\left[ I_{S}\left( m_{E_{2}},m_{H_{1}}\right) -I_{S}\left( m_{E_{2}},m_{H_{2}}\right) \right. \nonumber \\&\left. +I_{P}\left( m_{E_{2}},m_{A_{1}}\right) -I_{P}\left( m_{E_{2}},m_{A_{2}}\right) \right] \sin \theta \cos \theta \nonumber \\&+\frac{m_{\mu }^{2}}{8\pi ^{2}M_{Z^{\prime }}^{2}}I_{V}\left( M_{Z^{\prime }}\right) , \end{aligned}$$
(14)

where the loop integrals are given by [52, 53]:

$$\begin{aligned}&I_{S\left( P\right) }\left( m_{E},m\right) \nonumber \\&=\int _{0}^{1}\frac{x^{2}\left( 1-x\pm \frac{m_{E}}{m_{\mu }}\right) }{m_{\mu }^{2}x^{2}+\left( m_{E}^{2}-m_{\mu }^{2}\right) x+m^{2}\left( 1-x\right) }dx, \nonumber \\&I_{V}\left( M_{Z^{\prime }}\right) =\int _{0}^{1}\frac{g_{V}^{2}P_{V}\left( x\right) +g_{A}^{2}P_{A}\left( x\right) }{\left( 1-x\right) \left( 1-\frac{ m_{\mu }^{2}}{M_{Z^{\prime }}^{2}}x\right) +\frac{m_{\mu }^{2}}{M_{Z^{\prime }}^{2}}x}dx, \nonumber \\&\quad P_{V}\left( x\right) =2x^{2}\left( 1-x\right) ,\nonumber \\&\quad P_{A}\left( x\right) =2x^{2}\left( 1-x\right) \left( x-4\right) -4\frac{ m_{\mu }^{2}}{M_{Z^{\prime }}^{2}}x^{3} \nonumber \\&\quad g_{L} =-3g_{X}, \nonumber \\&\quad g_{L}=-6g_{X}, \nonumber \\&\quad g_{V,A}=g_{R}\pm g_{L}. \end{aligned}$$
(15)

In our numerical analysis we have fixed \(\tan \theta =\frac{v}{v_{\sigma }}\) , \(M_{Z^{\prime }}=1.5\) TeV and \(g_{X}=0.1\), in consistency with the \( 2.6\sigma \) \(R_{K}\) anomaly. Considering that the muon anomalous magnetic moment is constrained to be in the range [54,55,56],

$$\begin{aligned} \left( \Delta a_{\mu }\right) _{\exp }=\left( 26.1\pm 8\right) \times 10^{-10} , \end{aligned}$$
(16)

we plot in Fig. 5 the allowed parameter space for \(M_{S}\)-\( M_{E}\) (left panel) and \(M_{A}\)-\(M_{E}\) (right panel) planes with different values for \(\Delta a_{\mu }\). Here, we have set \(M_{S}=\min \left( m_{H_{1}},m_{H_{2}}\right) \) and \(M_{A}=\min \left( m_{A_{1}},m_{A_{2}}\right) \) and \(M_{E}=m_{E_{2}}\). We found that our model can accommodate the experimental values of \(\Delta a_{\mu }\) for a large region of parameter space.

Fig. 5
figure 5

Allowed parameter space for \(M_{S}\)\(M_{E}\) (left panel) and \(M_{A}\)\(M_{E}\) (right panel) planes with different values of the muon anomalous magnetic moment

5 DM particle candidates

Note that due to the exact \(Z_{2}^{(2)}\) discrete symmetry, our model has several stable scalar DM (DM) candidates, which can be the neutral components of the inert \(SU_{2L}\) scalar doublet \(\phi _{2}\) as well as the real and imaginary parts of the SM scalar singlets \(\sigma _{2}\), \( \sigma _{3}\), \(\rho _{1}\), \(\rho _{2}\) and \(\eta \). Furthermore, the model can have a fermionic DM candidate, which is the only SM-singlet Majorana neutrino \(\Omega _{1R}\) with a non-trivial \(Z_{2}^{(2)}\) charge.

Considering a scenario with a scalar DM candidate, one has to ensure its stability. This can be done by assuming that it is the lightest among the inert scalar particles and is lighter than the exotic fermions. That scalar DM candidate annihilates mainly into WW, ZZ, \(t{\overline{t}}\), \(b{\overline{b}}\) and hh via a Higgs portal scalar interaction \(\left( \phi ^{\dagger }_1\phi _1\right) \Phi ^{\dagger }_{DM}\Phi _{DM}\), where \(\phi _1\) is the SM Higgs doublet and \( \Phi _{DM}\) the scalar DM candidate in our model. These annihilation channels will contribute to the DM relic density, which can be accommodated for appropriate values of the scalar DM mass and of the quartic scalar coupling of the corresponding Higgs portal scalar interaction \(\left( \phi ^{\dagger }_1 \phi _1\right) \Phi ^{\dagger }_{DM}\Phi _{DM}\), similarly as in Refs. [6, 7, 57, 58]. Thus, for DM direct detection prospects, the scalar DM candidate would scatter off a nuclear target in a detector via Higgs boson exchange in the t-channel, giving rising to a constraint on the coupling of the \( \left( \phi ^{\dagger }_1\phi _1\right) \Phi ^{\dagger }_{DM}\Phi _{DM}\) interaction. Given the large number of parameters in the scalar potential of our model (which is discussed in detail in our previous work [16]), there is a lot of parametric freedom that allows us to reproduce

the observed value of the DM relic density and the parameter space of our model consistent with DM constraints will be similar to the one in Refs.  [6, 7, 57, 58].

For instance, in the case, where \(m_{{\Phi _{DM}}}^{2}>>v^{2}\), with \(v=246\) GeV, and neglecting the annihilation channel of the scalar DM candidate into neutrino-antineutrino pairs as in Ref. [6], the freeze-out of heavy scalar DM particle will be largely dominated by the annihilations into Higgs bosons and the corresponding thermally averaged cross section can be estimated as

$$\begin{aligned} <\sigma v>\simeq \frac{\gamma ^{2}}{128\pi m_{{\Phi _{DM} }}^{2}}, \end{aligned}$$
(17)

which results in a DM relic abundance

$$\begin{aligned} \frac{\Omega _{DM}h^{2}}{0.12}=\frac{0.1pb}{0.12<\sigma v>}\simeq \left( \frac{1}{\gamma }\right) ^{2}\left( \frac{m_{{\Phi _{DM} }}}{1.1TeV}\right) ^{2}, \end{aligned}$$
(18)

with \(\gamma \) being the quartic scalar coupling of the Higgs portal scalar interaction \(\left( \phi ^{\dagger }_1\phi _1\right) \Phi ^{\dagger }_{DM}\Phi _{DM}\). Consequently, our model naturally reproduces the observed value [59]

$$\begin{aligned} \Omega _{DM}h^{2}=0.1198 \end{aligned}$$
(19)

for the DM relic density.

In the scenario with a fermionic DM candidate, it follows from the Yukawa interactions \(\overline{\Omega _{1R}^{C}}\eta ^{*}\nu _{kR}\) and \( \overline{\Omega _{1R}^{C}}\eta \Psi _{R}\) that the DM candidate \(\Omega _{1R}\) can annihilate into a pair of the right-handed Majorana neutrinos \(\nu _{kR}\) (\(k=1,3\)) and \(\Psi _R\), via t channel exchange of the real and imaginary parts of the gauge singlet scalar \(\eta \). Additionally, the fermionic DM candidate \(\Omega _{1R}\) can also annihilate into \(\eta _R\eta _R\) and \( \eta _I\eta _I\) via the the t channel exchange of the right handed Majorana neutrinos \(\nu _{kR}\) (\(k=1,3\)) and \(\Psi _R\). Thus, the corresponding relic density will depend on the neutrino Yukawa coupling of the aforementioned Yukawa interactions, on the fermionic DM candidate mass \(m_{\Omega _{1R}}\), on the masses of the the right-handed Majorana neutrinos \(\nu _{kR}\) (\(k=1,3\)), \(\Psi _R\), as well as on the masses of the real and imaginary parts of the gauge singlet scalar \(\eta \).

Considering a scenario where \(m_{{\Omega _{1R}}}^{2}{<<}m_{{\ \eta _{R}} }^{2}\sim m_{{\eta _{I}}}^{2}\sim m_{{\eta }}^{2}\), and the annihilation channel \(\Omega _{1R}\Omega _{1R}\rightarrow \nu _{kR}\nu _{kR}\) (\(k=1,3\)), following Ref. [6] one can estimate the corresponding thermally averaged cross section as

$$\begin{aligned} <\sigma v>\simeq \frac{9y_{\Omega }^{4}m_{{\Omega }}^{2}}{16\pi m_{{\eta } }^{4}}. \end{aligned}$$
(20)

Then, the DM relic abundance is

$$\begin{aligned}&\frac{\Omega _{DM}h^{2}}{0.12}\nonumber \\&\quad =\frac{0.1pb}{0.12<\sigma v>}\simeq \left( \frac{1}{y_{\Omega }}\right) ^{4}\left( \frac{400GeV}{m_{{\Omega }}} \right) ^{2}\left( \frac{m_{{\eta }}}{1.9TeV}\right) ^{4},\nonumber \\ \end{aligned}$$
(21)

showing that in the case of fermionic DM candidate our model also naturally reproduces the observed value (19).

6 Conclusions

We have studied some phenomenological aspects of the extended Inert Higgs Doublet model, which incorporates the mechanism of sequential loop-generation of the SM fermion masses, explaining the observed strong hierarchies between them as well as the corresponding mixing parameters. A particular emphasis has been made on analyzing the constraints on the \(Z^{\prime }\) mass and couplings of our model, imposed by the \(2.6\sigma \) anomaly in lepton universality, the LEP constraint on the \( M_{Z^{\prime }}/g_{X}\) ratio and the constraints arising from the experimental measurements of the muon anomalous magnetic moment. Furthermore, we have studied production of the heavy \(Z^{\prime }\) gauge boson in proton–proton collisions via the Drell-Yan mechanism. We found that the corresponding total cross section at the LHC is equal to 0.2–1 pb when the heavy \(Z^{\prime }\) mass is varied within 1.5–2 TeV interval for the \( U_{1X}\) gauge coupling \(g_X=0.1\). The \(Z^{\prime }\) production cross section gets significantly enhanced at a future 100 TeV proton-proton collider reaching the typical values of 9–29 pb. Additionally, we have found that the \(2.6\sigma \) anomaly in lepton universality yields a tighter constraint than the one obtained from the \(e^{+}e^{-}\rightarrow \mu ^{+}\mu ^{-}\) measurement at LEP and implies a lower bound of \(\approx 13\) TeV on the \( M_{Z^{\prime }}/g_{X}\) ratio. We have found that our model successfully accommodates the experimental values of the muon magnetic moment for a large region of parameter space. Finally, we have examined the possible fermion and scalar DM particle candidates of the model and showed that in both cases our predictions are compatible with the observed DM relic density abundance.