在 Linux 上以 All-in-One 模式安装 KubeSphere
2024-06-03 22:11:01
前言
最近部门内需要进行私有化部署，所以这个系列主要是以docker+Kubernetes 技术选型和的调研为主了。
很久没有更新博客，这里把自己的随笔记录到博客中，后续再进行详细整理吧
一、在 Linux 上以 All-in-One 模式安装 KubeSphere
为什么不纯手动安全k8s呢？
首先我们是想选购一个成型的标准封装尽量简化我们的安装流程。
其次我们如果实现这个标品是ok的那么，其实就获得了它的离线安装能力。
当然也有一些缺点，我们不清楚内部构造，重启服务遇到问题时，我们也无法进行问题解决，所以我感觉先试用这个服务后续还要进行一把纯手动安装这样要清楚的知道哪部分出了啥问题。
安装步骤
前置准备
我是用mac电脑安装的vmware进行的操作，因为它只能支持linux下的操作环境。然后你需要下载centos7的镜像，然后把你的虚拟机安装才行。
实际安装
参照网址安装：
https://kubesphere.com.cn/docs/quick-start/all-in-one-on-linux/
安装步骤如下：
#需要先下个叫kk的小东西
export KKZONE=cn
curl -sfL https://get-kk.kubesphere.io | VERSION=v2.0.0 sh -
#开始安装，设置版本号
./kk create cluster --with-kubernetes v1.21.5 --with-kubesphere v3.2.1
#然后大体操作流程就是它会从各种数据源中获取到镜像文件
downloading amd64 kubelet v1.21.5 ...
21:56:43 PDT message: [localhost]
#执行安装这些镜像和install的镜像
21:59:53 PDT [InstallETCDBinaryModule] Install etcd using binary
21:59:54 PDT success: [localhost.localdomain.cluster.local]
#最后会卡到这里，最后那个点就是菊花了，一直等它转完就ok了
#这里的速度取决于机器配置了，2CPU 4G内存，至少半小时。
clusterconfiguration.installer.kubesphere.io/ks-installer created
22:00:43 PDT success: [localhost.localdomain.cluster.local]
Please wait for the installation to complete: >>--->
#安装完毕是这个界面：
#####################################################
### Welcome to KubeSphere! ###
#####################################################Console: http://192.168.3.64:30880
Account: admin
Password: P@88w0rdNOTES：1. After you log into the console, please check themonitoring status of service components in"Cluster Management". If any service is notready, please wait patiently until all componentsare up and running.2. Please change the default password after login.#####################################################
https://kubesphere.io 2022-06-02 22:14:25
#####################################################
22:14:29 PDT success: [localhost.localdomain.cluster.local]
22:14:29 PDT Pipeline[CreateClusterPipeline] execute successful
Installation is complete.Please check the result using the command:kubectl logs -n kubesphere-system $(kubectl get pod -n kubesphere-system -l app=ks-install -o jsonpath='{.items[0].metadata.name}') -f
记录一下当前机器的images和ps容器，方便后续排查问题。真是感觉后续可能有问题不好排查，因为k8s的文档才是最全的。
[root@localhost ~]# docker images
REPOSITORY TAG IMAGE ID CREATED SIZE
kubesphere/ks-installer v3.2.1 7f833c28ad87 5 months ago 383MB
kubesphere/ks-controller-manager v3.2.1 ea90d211235f 5 months ago 168MB
kubesphere/ks-apiserver v3.2.1 be3514bdedbc 5 months ago 191MB
kubesphere/ks-console v3.2.1 d7026f326408 5 months ago 112MB
kubesphere/kubectl v1.21.0 f1e3bb4ed882 7 months ago 79MB
kubesphere/notification-manager v1.4.0 b8b2f6b3790f 7 months ago 51.8MB
kubesphere/notification-tenant-sidecar v3.2.0 4b47c43ec6ab 8 months ago 52.8MB
kubesphere/notification-manager-operator v1.4.0 08ca8def2520 8 months ago 46.2MB
kubesphere/kube-apiserver v1.21.5 7b2ac941d4c3 8 months ago 126MB
registry.cn-beijing.aliyuncs.com/kubesphereio/kube-apiserver v1.21.5 7b2ac941d4c3 8 months ago 126MB
kubesphere/kube-proxy v1.21.5 e08abd2be730 8 months ago 104MB
registry.cn-beijing.aliyuncs.com/kubesphereio/kube-proxy v1.21.5 e08abd2be730 8 months ago 104MB
kubesphere/kube-controller-manager v1.21.5 184ef4d127b4 8 months ago 120MB
registry.cn-beijing.aliyuncs.com/kubesphereio/kube-controller-manager v1.21.5 184ef4d127b4 8 months ago 120MB
kubesphere/kube-scheduler v1.21.5 8e60ea3644d6 8 months ago 50.8MB
registry.cn-beijing.aliyuncs.com/kubesphereio/kube-scheduler v1.21.5 8e60ea3644d6 8 months ago 50.8MB
calico/node v3.20.0 5ef66b403f4f 10 months ago 170MB
calico/pod2daemon-flexvol v3.20.0 5991877ebc11 10 months ago 21.7MB
calico/cni v3.20.0 4945b742b8e6 10 months ago 146MB
calico/kube-controllers v3.20.0 76ba70f4748f 10 months ago 63.2MB
openebs/provisioner-localpv 2.10.1 b5e01d57c971 11 months ago 62.7MB
kubesphere/pause 3.4.1 0f8457a4c2ec 16 months ago 683kB
registry.cn-beijing.aliyuncs.com/kubesphereio/pause 3.4.1 0f8457a4c2ec 16 months ago 683kB
csiplugin/snapshot-controller v4.0.0 f1d8a00ae690 17 months ago 46.6MB
kubesphere/prometheus-config-reloader v0.43.2 08ed6bfd22b5 19 months ago 13.4MB
kubesphere/prometheus-operator v0.43.2 4ad0a8e16901 19 months ago 41.9MB
kubesphere/kube-rbac-proxy v0.8.0 ad393d6a4d1b 19 months ago 49MB
coredns/coredns 1.8.0 296a6d5035e2 19 months ago 42.5MB
registry.cn-beijing.aliyuncs.com/kubesphereio/coredns 1.8.0 296a6d5035e2 19 months ago 42.5MB
prom/alertmanager v0.21.0 c876f5897d7b 23 months ago 55.5MB
kubesphere/kube-state-metrics v1.9.7 6497f02dbdad 24 months ago 32.8MB
kubesphere/k8s-dns-node-cache 1.15.12 5340ba194ec9 2 years ago 107MB
prom/node-exporter v0.18.1 e5a616e4b9cf 2 years ago 22.9MB
mirrorgooglecontainers/defaultbackend-amd64 1.4 846921f0fe0e 4 years ago 4.84MB[root@localhost ~]# docker ps
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
7182bd2263bc kubesphere/kubectl "entrypoint.sh" 2 minutes ago Up 2 minutes k8s_kubectl_kubectl-admin-6667774bb-8hdbr_kubesphere-controls-system_71f76418-3d48-4f0a-bc24-39c0ddfcdd8b_0
e5f7d753fc8b kubesphere/pause:3.4.1 "/pause" 3 minutes ago Up 3 minutes k8s_POD_kubectl-admin-6667774bb-8hdbr_kubesphere-controls-system_71f76418-3d48-4f0a-bc24-39c0ddfcdd8b_0
c404189a1b3f kubesphere/ks-controller-manager "controller-manager …" 3 minutes ago Up 3 minutes k8s_ks-controller-manager_ks-controller-manager-6bdbc4d56-qgqc8_kubesphere-system_a5813eaa-f457-4500-91a6-81c23711db2e_0
7a10ca1c5d6d kubesphere/ks-apiserver "ks-apiserver --logt…" 3 minutes ago Up 3 minutes k8s_ks-apiserver_ks-apiserver-8484959456-k5fqx_kubesphere-system_759c72b1-36c5-46b5-9cfa-2dd2ddd86bfd_0
9d7af515835e kubesphere/pause:3.4.1 "/pause" 3 minutes ago Up 3 minutes k8s_POD_ks-controller-manager-6bdbc4d56-qgqc8_kubesphere-system_a5813eaa-f457-4500-91a6-81c23711db2e_0
06a75444266b kubesphere/pause:3.4.1 "/pause" 3 minutes ago Up 3 minutes k8s_POD_ks-apiserver-8484959456-k5fqx_kubesphere-system_759c72b1-36c5-46b5-9cfa-2dd2ddd86bfd_0
f29dc368c6f3 kubesphere/notification-tenant-sidecar "/tenant-sidecar" 4 minutes ago Up 4 minutes k8s_tenant_notification-manager-deployment-78664576cb-k4xkt_kubesphere-monitoring-system_17e94aa1-150f-44e4-958d-6706e3db83a9_0
70dc8d507884 kubesphere/notification-manager "/notification-manag…" 4 minutes ago Up 4 minutes k8s_notification-manager_notification-manager-deployment-78664576cb-k4xkt_kubesphere-monitoring-system_17e94aa1-150f-44e4-958d-6706e3db83a9_0
1f30e708aa3f kubesphere/pause:3.4.1 "/pause" 4 minutes ago Up 4 minutes k8s_POD_notification-manager-deployment-78664576cb-k4xkt_kubesphere-monitoring-system_17e94aa1-150f-44e4-958d-6706e3db83a9_0
15c9d9c549a2 kubesphere/notification-manager-operator "/notification-manag…" 5 minutes ago Up 5 minutes k8s_notification-manager-operator_notification-manager-operator-7d44854f54-lmvt8_kubesphere-monitoring-system_abf70a62-f110-492c-983c-174230dbe354_0
d56a4d6b30fb kubesphere/prometheus-config-reloader "/bin/prometheus-con…" 5 minutes ago Up 5 minutes k8s_config-reloader_alertmanager-main-0_kubesphere-monitoring-system_d4d538de-a7fc-4990-92bb-67a05e8b5fb3_0
8d5dd9365770 ad393d6a4d1b "/usr/local/bin/kube…" 5 minutes ago Up 5 minutes k8s_kube-rbac-proxy-self_kube-state-metrics-5547ddd4cc-8gmzt_kubesphere-monitoring-system_72c5e270-8c12-4b7e-be8a-a67007147841_0
e1ffb874c1c1 kubesphere/kube-rbac-proxy "/usr/local/bin/kube…" 5 minutes ago Up 5 minutes k8s_kube-rbac-proxy-main_kube-state-metrics-5547ddd4cc-8gmzt_kubesphere-monitoring-system_72c5e270-8c12-4b7e-be8a-a67007147841_0
e18fcadb2e05 kubesphere/kube-rbac-proxy "/usr/local/bin/kube…" 5 minutes ago Up 5 minutes k8s_kube-rbac-proxy_node-exporter-px22q_kubesphere-monitoring-system_5770efd5-7df5-4b40-b9d0-fd1f67abf0a4_0
06513567f672 ad393d6a4d1b "/usr/local/bin/kube…" 5 minutes ago Up 5 minutes k8s_kube-rbac-proxy_notification-manager-operator-7d44854f54-lmvt8_kubesphere-monitoring-system_abf70a62-f110-492c-983c-174230dbe354_0
18fcbbb9c4e0 prom/alertmanager "/bin/alertmanager -…" 5 minutes ago Up 5 minutes k8s_alertmanager_alertmanager-main-0_kubesphere-monitoring-system_d4d538de-a7fc-4990-92bb-67a05e8b5fb3_0
285402dd9ef4 kubesphere/pause:3.4.1 "/pause" 5 minutes ago Up 5 minutes k8s_POD_notification-manager-operator-7d44854f54-lmvt8_kubesphere-monitoring-system_abf70a62-f110-492c-983c-174230dbe354_0
c7d91da7b61a kubesphere/kube-rbac-proxy "/usr/local/bin/kube…" 6 minutes ago Up 6 minutes k8s_kube-rbac-proxy_prometheus-operator-5c5db79546-cs47w_kubesphere-monitoring-system_9c234076-e562-4b5d-8d0a-36a957a8e783_0
e416db2686d9 kubesphere/kube-state-metrics "/kube-state-metrics…" 6 minutes ago Up 6 minutes k8s_kube-state-metrics_kube-state-metrics-5547ddd4cc-8gmzt_kubesphere-monitoring-system_72c5e270-8c12-4b7e-be8a-a67007147841_0
c1d8c91dcaca prom/node-exporter "/bin/node_exporter …" 6 minutes ago Up 6 minutes k8s_node-exporter_node-exporter-px22q_kubesphere-monitoring-system_5770efd5-7df5-4b40-b9d0-fd1f67abf0a4_0
ad6043cffaee kubesphere/pause:3.4.1 "/pause" 7 minutes ago Up 7 minutes k8s_POD_alertmanager-main-0_kubesphere-monitoring-system_d4d538de-a7fc-4990-92bb-67a05e8b5fb3_0
a3393a75fbfa kubesphere/prometheus-operator "/bin/operator --kub…" 7 minutes ago Up 7 minutes k8s_prometheus-operator_prometheus-operator-5c5db79546-cs47w_kubesphere-monitoring-system_9c234076-e562-4b5d-8d0a-36a957a8e783_0
41f30e2f4518 kubesphere/pause:3.4.1 "/pause" 7 minutes ago Up 7 minutes k8s_POD_kube-state-metrics-5547ddd4cc-8gmzt_kubesphere-monitoring-system_72c5e270-8c12-4b7e-be8a-a67007147841_0
880e0ec23330 kubesphere/pause:3.4.1 "/pause" 7 minutes ago Up 7 minutes k8s_POD_node-exporter-px22q_kubesphere-monitoring-system_5770efd5-7df5-4b40-b9d0-fd1f67abf0a4_0
a4423b96f988 kubesphere/pause:3.4.1 "/pause" 7 minutes ago Up 7 minutes k8s_POD_prometheus-operator-5c5db79546-cs47w_kubesphere-monitoring-system_9c234076-e562-4b5d-8d0a-36a957a8e783_0
0713f577689d mirrorgooglecontainers/defaultbackend-amd64 "/server" 10 minutes ago Up 10 minutes k8s_default-http-backend_default-http-backend-5bf68ff9b8-s8fg9_kubesphere-controls-system_334554f8-742c-4916-9602-20c41fb46687_0
c476b185eca2 kubesphere/ks-console "docker-entrypoint.s…" 11 minutes ago Up 11 minutes k8s_ks-console_ks-console-65f4d44d88-lhrhn_kubesphere-system_1eebb6e1-77a6-4f2b-b6dd-5d06201ba50a_0
915269bad362 kubesphere/pause:3.4.1 "/pause" 11 minutes ago Up 10 minutes k8s_POD_default-http-backend-5bf68ff9b8-s8fg9_kubesphere-controls-system_334554f8-742c-4916-9602-20c41fb46687_0
892afa1d6f41 kubesphere/pause:3.4.1 "/pause" 11 minutes ago Up 11 minutes k8s_POD_ks-console-65f4d44d88-lhrhn_kubesphere-system_1eebb6e1-77a6-4f2b-b6dd-5d06201ba50a_0
87ade779eb4b csiplugin/snapshot-controller "/snapshot-controlle…" 13 minutes ago Up 13 minutes k8s_snapshot-controller_snapshot-controller-0_kube-system_57b2b84d-73f7-4f73-be2c-fe5b644d2166_0
d409d6877100 kubesphere/pause:3.4.1 "/pause" 14 minutes ago Up 14 minutes k8s_POD_snapshot-controller-0_kube-system_57b2b84d-73f7-4f73-be2c-fe5b644d2166_0
701e02c0e155 kubesphere/ks-installer "/shell-operator sta…" 14 minutes ago Up 14 minutes k8s_installer_ks-installer-57bdbbf866-rflmb_kubesphere-system_19fe77fd-e284-4a1b-8001-8ad9ab8bb72a_0
fea3a2dd2bbe openebs/provisioner-localpv "/usr/local/bin/prov…" 15 minutes ago Up 15 minutes k8s_openebs-provisioner-hostpath_openebs-localpv-provisioner-5bfb67894-ss5rr_kube-system_1a5a1562-6290-44b4-9832-46275abab02e_0
44d585914e7c 76ba70f4748f "/usr/bin/kube-contr…" 16 minutes ago Up 16 minutes k8s_calico-kube-controllers_calico-kube-controllers-846b5f484d-zhhfz_kube-system_98d57d33-cde2-4e53-9a80-1d4725cb4854_0
505861c73e9d 296a6d5035e2 "/coredns -conf /etc…" 16 minutes ago Up 16 minutes k8s_coredns_coredns-b5648d655-jq7c9_kube-system_c588a69a-2bb1-40d8-9af9-de413002be1c_0
5cabab158b9b 296a6d5035e2 "/coredns -conf /etc…" 16 minutes ago Up 16 minutes k8s_coredns_coredns-b5648d655-vj27d_kube-system_22a5751f-cbe3-4502-9946-8195f4857af0_0
8a79445d4d23 kubesphere/pause:3.4.1 "/pause" 16 minutes ago Up 16 minutes k8s_POD_calico-kube-controllers-846b5f484d-zhhfz_kube-system_98d57d33-cde2-4e53-9a80-1d4725cb4854_0
8c1fbe9f2505 kubesphere/pause:3.4.1 "/pause" 16 minutes ago Up 16 minutes k8s_POD_coredns-b5648d655-jq7c9_kube-system_c588a69a-2bb1-40d8-9af9-de413002be1c_0
91986c7d5aac kubesphere/pause:3.4.1 "/pause" 16 minutes ago Up 16 minutes k8s_POD_coredns-b5648d655-vj27d_kube-system_22a5751f-cbe3-4502-9946-8195f4857af0_0
eea07d7ac04f kubesphere/pause:3.4.1 "/pause" 16 minutes ago Up 16 minutes k8s_POD_ks-installer-57bdbbf866-rflmb_kubesphere-system_19fe77fd-e284-4a1b-8001-8ad9ab8bb72a_0
a5a53bbef628 kubesphere/pause:3.4.1 "/pause" 16 minutes ago Up 16 minutes k8s_POD_openebs-localpv-provisioner-5bfb67894-ss5rr_kube-system_1a5a1562-6290-44b4-9832-46275abab02e_0
1ecb779dc559 5ef66b403f4f "start_runit" 16 minutes ago Up 16 minutes k8s_calico-node_calico-node-6tcxw_kube-system_f9e3f88a-7a93-46ef-bc1d-169499d4b46c_0
b915ae317cb9 5340ba194ec9 "/node-cache -locali…" 16 minutes ago Up 16 minutes k8s_node-cache_nodelocaldns-rrjm4_kube-system_fa933637-3820-4928-824c-786d9d04726d_0
811c9a921570 kubesphere/pause:3.4.1 "/pause" 16 minutes ago Up 16 minutes k8s_POD_calico-node-6tcxw_kube-system_f9e3f88a-7a93-46ef-bc1d-169499d4b46c_0
9132527c3b84 kubesphere/pause:3.4.1 "/pause" 16 minutes ago Up 16 minutes k8s_POD_nodelocaldns-rrjm4_kube-system_fa933637-3820-4928-824c-786d9d04726d_0
052654e47894 e08abd2be730 "/usr/local/bin/kube…" 16 minutes ago Up 16 minutes k8s_kube-proxy_kube-proxy-rl6cd_kube-system_30bd16dc-d903-43ac-9097-7ca81d8d50a3_0
3f8fc2c40807 kubesphere/pause:3.4.1 "/pause" 16 minutes ago Up 16 minutes k8s_POD_kube-proxy-rl6cd_kube-system_30bd16dc-d903-43ac-9097-7ca81d8d50a3_0
fcb14f803f14 8e60ea3644d6 "kube-scheduler --au…" 16 minutes ago Up 16 minutes k8s_kube-scheduler_kube-scheduler-localhost.localdomain.cluster.local_kube-system_7cf4cd863cc5ab487dd736d4522d6f12_0
ab6bcef42a15 7b2ac941d4c3 "kube-apiserver --ad…" 16 minutes ago Up 16 minutes k8s_kube-apiserver_kube-apiserver-localhost.localdomain.cluster.local_kube-system_0adb32c5ad26f03fb28bb9ab8edaa102_0
a8b4d6f447e1 184ef4d127b4 "kube-controller-man…" 16 minutes ago Up 16 minutes k8s_kube-controller-manager_kube-controller-manager-localhost.localdomain.cluster.local_kube-system_b9a94bd9cc5c6634574a714b347777e4_0
d47a1ecabaec kubesphere/pause:3.4.1 "/pause" 16 minutes ago Up 16 minutes k8s_POD_kube-scheduler-localhost.localdomain.cluster.local_kube-system_7cf4cd863cc5ab487dd736d4522d6f12_0
747bb4a37c24 kubesphere/pause:3.4.1 "/pause" 16 minutes ago Up 16 minutes k8s_POD_kube-controller-manager-localhost.localdomain.cluster.local_kube-system_b9a94bd9cc5c6634574a714b347777e4_0
7af423fd5f87 kubesphere/pause:3.4.1 "/pause" 16 minutes ago Up 16 minutes k8s_POD_kube-apiserver-localhost.localdomain.cluster.local_kube-system_0adb32c5ad26f03fb28bb9ab8edaa102_0
思考:我们安装k8s需要解决哪些问题？
以优先级高地排名吧
- 服务高可用问题
- 服务纯离线部署问题
- 服务devops问题
- 服务监控问题
在 Linux 上以 All-in-One 模式安装 KubeSphere相关推荐
- linux上常用命令及通用软件安装
linux上常用命令及通用软件安装记录. 1, 查询检索 1.1 根据安装包的名字检索安装 rpm 命令: rmp 全称:redhat package manager 参数说明: -a 查询所有套件 ...
- linux 卸载 1.6,在linux上卸载nump1.6.1并安装nump1.5.1，[它将要使用gipsyoasi II version6]...
我将尝试GIPSY-OASIS II版本6,因此我已经在Linux上的python2.7.3上安装了numpy-1.6.1,当我试图验证它时(由我的顾问编写并成功运行过)[我是Linux和Python ...
- CentOS通过 All-in-One 模式安装 KubeSphere技巧
对于刚接触 KubeSphere 并想快速上手该容器平台的用户,All-in-One 安装模式是最佳的选择,它能够帮助您零配置快速部署 KubeSphere 和 Kubernetes. 1. 安装Ce ...
- 【收藏】在 Linux 上以 All-in-One 模式安装 KubeSphere
https://kubesphere.com.cn/docs/quick-start/all-in-one-on-linux/
- 在 Centos 7.9 上以 All-in-One 模式安装 KubeSphere
对于刚接触 KubeSphere 并想快速上手该容器平台的用户,All-in-One 安装模式是最佳的选择,它能够帮助您零配置快速部署 KubeSphere 和 Kubernetes. 录屏视频请观看 ...
- 【dstat】Linux上全能系统监控工具dstat的安装和使用
一.安装dstat # yum -y install dstat # yum info dstat 二.相关使用 命令参数 在dstat命令中有很多参数可选,你可以通过man dstat命令查看,大多 ...
- All-in-One 模式安装 KubeSphere 异常问题记录
环境 腾讯云2核4g服务器 官方文档 https://kubesphere.io/zh/docs/quick-start/all-in-one-on-linux/ 安装步骤: 修改主机名(坑:名称不能 ...
- linux系统安装word,Linux系统入门学习 - 如何在Linux上安装WPS
问题: 我听说一个好东西Kingsoft Office(译注:就是WPS),所以我想在我的Linux上试试.我怎样才能安装Kingsoft Office呢? Kingsoft Office 是一套办公 ...
- Linux上oracle的安装
Linux版本:Red Hat Enterprise Linux5.0 Oracle版本:oracle 11g Linux版本检查 #cat /etc/issue 首先检查自己安装的linux5.0上 ...
最新文章
- BOM和DOM的区别
- 数字化转型案例：源自阿里，中台设计流程及方法
- grep,egrep及元字符和posix字符集
- RabbitMQ单个发布确认
- html 轮播 平移,网站轮播图的实现-平移版
- Winform中用了皮肤控件之后，报错:容量超出了最大容量 参数名:capacity
- 【资料整理】cisco [acl]
- WP7 App性能优化（12）：检测应用程序性能（Ⅴ）
- httpsecurity 类方法介绍_java知识学习25-内部类 - 那种意境
- 鼠标宏设置到鼠标左键，重置回去！
- 简单好玩的手机编程代码
- java解码acc音频文件_（JAVA）将（acc/m4a）音频转换成Mp3格式
- ubuntu 下载工具 easyMule2.0
- html设置图片高度宽度自适应屏幕,css让图片自适应屏幕大小的方法
- 计算机ip地址会变吗,电脑IP地址会变吗？
- 设计模式的艺术 结构性模式之组合模式
- 虾皮男装类目市场如何？哪些产品好卖？
- 麦子学院深度学习视频课程（中文授课、代码讲解为主）
- css fixed定位失效问题
- 表达式 625%2.5 是合法的c语言表达式,2018-C程序设计-期末自测题.doc