spark-integration-tests:Spark 的集成测试-源码

上传者: 42116794 | 上传时间: 2021-06-02 20:03:02 | 文件大小: 56KB | 文件类型: ZIP
Spark 集成测试 该项目包含基于的 Spark 集成测试,包括 Spark 独立集群管理器的容错测试。 安装/设置 安装 Docker 该项目依赖于 Docker >= 1.3.0(它可能适用于早期版本,但尚未经过测试)。 在 Linux 上 安装 Docker。 这个测试套件要求 Docker 可以在没有sudo情况下运行(参见 )。 在 OSX 上 在 OSX 上,这些集成测试可以使用运行。 首先, ,运行安装程序,然后运行~/Applications/boot2docker以执行一些一次性设置(创建 VM 等)。 这个项目已经用boot2docker 1.3.0+ 测试过。 使用boot2docker ,Docker 容器将在 VirtualBox VM 内运行,这会给 Mac 主机和容器之间的通信带来一些困难。 请按照以下说明解决这些问题: 网络访问:我们的测试当前从容器

文件下载

资源详情

[{"title":"( 38 个子文件 56KB ) spark-integration-tests:Spark 的集成测试-源码","children":[{"title":"spark-integration-tests-master","children":[{"title":"init.sh <span style='color:#111;'> 5.12KB </span>","children":null,"spread":false},{"title":"project","children":[{"title":"build.properties <span style='color:#111;'> 803B </span>","children":null,"spread":false},{"title":"SparkIntegrationTestsBuild.scala <span style='color:#111;'> 2.25KB </span>","children":null,"spread":false},{"title":"plugins.sbt <span style='color:#111;'> 69B </span>","children":null,"spread":false}],"spread":true},{"title":"docker","children":[{"title":"build.sh <span style='color:#111;'> 375B </span>","children":null,"spread":false},{"title":"kafka","children":[{"title":"start-kafka.sh <span style='color:#111;'> 905B </span>","children":null,"spread":false},{"title":"Dockerfile <span style='color:#111;'> 494B </span>","children":null,"spread":false},{"title":"README.md <span style='color:#111;'> 229B </span>","children":null,"spread":false}],"spread":true},{"title":"spark-master","children":[{"title":"Dockerfile <span style='color:#111;'> 870B </span>","children":null,"spread":false},{"title":"default_cmd <span style='color:#111;'> 1.14KB </span>","children":null,"spread":false}],"spread":true},{"title":"base","children":[{"title":"Dockerfile <span style='color:#111;'> 1.51KB </span>","children":null,"spread":false}],"spread":true},{"title":"spark-worker","children":[{"title":"Dockerfile <span style='color:#111;'> 904B </span>","children":null,"spread":false},{"title":"default_cmd <span style='color:#111;'> 1.13KB </span>","children":null,"spread":false}],"spread":true},{"title":"README.md <span style='color:#111;'> 604B </span>","children":null,"spread":false}],"spread":true},{"title":"src","children":[{"title":"test","children":[{"title":"scala","children":[{"title":"org","children":[{"title":"apache","children":[{"title":"spark","children":[{"title":"integrationtests","children":[{"title":"docker","children":[{"title":"containers","children":[{"title":"kafka","children":[{"title":"KafkaBroker.scala <span style='color:#111;'> 1.27KB </span>","children":null,"spread":false}],"spread":true},{"title":"mesos","children":[{"title":"MesosCluster.scala <span style='color:#111;'> 3.04KB </span>","children":null,"spread":false}],"spread":false},{"title":"zookeeper","children":[{"title":"ZooKeeperMaster.scala <span style='color:#111;'> 1.25KB </span>","children":null,"spread":false}],"spread":false},{"title":"spark","children":[{"title":"SparkStandaloneCluster.scala <span style='color:#111;'> 6.98KB </span>","children":null,"spread":false}],"spread":false}],"spread":true},{"title":"DockerContainer.scala <span style='color:#111;'> 1.76KB </span>","children":null,"spread":false},{"title":"network","children":[{"title":"NetworkFaultInjector.scala <span style='color:#111;'> 5.03KB </span>","children":null,"spread":false}],"spread":false},{"title":"DockerUtilsSuite.scala <span style='color:#111;'> 3.58KB </span>","children":null,"spread":false},{"title":"Docker.scala <span style='color:#111;'> 2.82KB </span>","children":null,"spread":false}],"spread":true},{"title":"utils","children":[{"title":"kafka","children":[{"title":"KafkaProducer.scala <span style='color:#111;'> 1.77KB </span>","children":null,"spread":false},{"title":"KafkaClient.scala <span style='color:#111;'> 1.81KB </span>","children":null,"spread":false}],"spread":true},{"title":"spark","children":[{"title":"ProcessUtils.scala <span style='color:#111;'> 1.47KB </span>","children":null,"spread":false},{"title":"SparkSubmitUtils.scala <span style='color:#111;'> 2.68KB </span>","children":null,"spread":false}],"spread":false}],"spread":true},{"title":"PySparkAddJarsSuite.scala <span style='color:#111;'> 3.73KB </span>","children":null,"spread":false},{"title":"fixtures","children":[{"title":"TestFixtures.scala <span style='color:#111;'> 4.28KB </span>","children":null,"spread":false}],"spread":false},{"title":"ZKFaultToleranceSuite.scala <span style='color:#111;'> 5.58KB </span>","children":null,"spread":false},{"title":"MesosSuite.scala <span style='color:#111;'> 4.44KB </span>","children":null,"spread":false},{"title":"SparkSubmitSuite.scala <span style='color:#111;'> 4.17KB </span>","children":null,"spread":false},{"title":"SparkStandaloneSuite.scala <span style='color:#111;'> 2.65KB </span>","children":null,"spread":false}],"spread":true}],"spread":true}],"spread":true}],"spread":true}],"spread":true}],"spread":true}],"spread":true},{"title":"LICENSE <span style='color:#111;'> 9.94KB </span>","children":null,"spread":false},{"title":"README.md <span style='color:#111;'> 3.92KB </span>","children":null,"spread":false},{"title":"scalastyle-config.xml <span style='color:#111;'> 7.22KB </span>","children":null,"spread":false},{"title":".gitignore <span style='color:#111;'> 77B </span>","children":null,"spread":false},{"title":"dev","children":[{"title":"merge_pr.py <span style='color:#111;'> 6.62KB </span>","children":null,"spread":false},{"title":"check-style.sh <span style='color:#111;'> 102B </span>","children":null,"spread":false}],"spread":true}],"spread":true}],"spread":true}]

评论信息

免责申明

【只为小站】的资源来自网友分享,仅供学习研究,请务必在下载后24小时内给予删除,不得用于其他任何用途,否则后果自负。基于互联网的特殊性,【只为小站】 无法对用户传输的作品、信息、内容的权属或合法性、合规性、真实性、科学性、完整权、有效性等进行实质审查;无论 【只为小站】 经营者是否已进行审查,用户均应自行承担因其传输的作品、信息、内容而可能或已经产生的侵权或权属纠纷等法律责任。
本站所有资源不代表本站的观点或立场,基于网友分享,根据中国法律《信息网络传播权保护条例》第二十二条之规定,若资源存在侵权或相关问题请联系本站客服人员,zhiweidada#qq.com,请把#换成@,本站将给予最大的支持与配合,做到及时反馈和处理。关于更多版权及免责申明参见 版权及免责申明