Recent studies demonstrate that immune checkpoint inhibitor (ICI) therapy has achieved success in many types of advanced cancers including advanced hepatocellular carcinoma (HCC). However, ICI therapy is beneficial in only some HCC patients, suggesting that immune-responses are highly variable in HCCs. Therefore, understanding the immune status in HCC microenvironment will facilitate ICI immunotherapy and guide patient selection for the therapy. In this study, we first analyzed the expression profile of immune-modulating genes and their relationship with survival of HCC patients using the data downloaded from The Cancer Genome Atlas - Liver Hepatocellular Carcinoma (TCGA-LIHC) database, and found that the higher expressions of CD276 (B7-H3) and CD47 were significantly associated with poor survival. Then we identified 4 immune subtypes of HCCs with different survivals by using the combination expression of B7-H3 (or CD47) and CD8. Patients with B7-H3low/CD8high or CD47low/CD8high have the best survival while ones with B7-H3high/CD8low or CD47high/CD8low have the worst survival. The 4 immune subtypes were validated in another 72 HCC patients obtained from South China. In conclusion, our findings suggest that HCC patient prognosis is associated with immunophenotypes by T cell infiltration (CD8 expression) and the expression of the adaptive immune resistance gene (B7-H3 or CD47), and this immune classification system will facilitate HCC patient selection for ICI immunotherapy.