使用嵌入式Mongo DB的Spring Boot测试启动非常缓慢

3

即使运行一个测试也需要超过1分钟:

  • 启动嵌入式Mongo约1分钟
  • 测试执行时间为3-8秒

我不明白这种行为的原因是什么?
以下是控制台中的片段:

2018-12-13 13:14:43.214  INFO 12277 --- [           main] c.j.s.embedmongo.EmbeddedMongoBuilder    : Initializing embedded MongoDB instance
2018-12-13 13:14:43.293  INFO 12277 --- [           main] d.f.embed.process.store.Downloader       : Extract /Users/nazar/.embedmongo/osx/mongodb-osx-ssl-x86_64-3.6.5.tgz : starting...
2018-12-13 13:14:44.287  INFO 12277 --- [           main] d.f.embed.process.store.Downloader       : Extract /Users/nazar/.embedmongo/osx/mongodb-osx-ssl-x86_64-3.6.5.tgz : extract mongodb-osx-x86_64-3.6.5/bin/mongod
2018-12-13 13:14:44.288  INFO 12277 --- [           main] d.f.embed.process.store.Downloader       : Extract /Users/nazar/.embedmongo/osx/mongodb-osx-ssl-x86_64-3.6.5.tgz : nothing left
2018-12-13 13:14:44.288  INFO 12277 --- [           main] d.f.embed.process.store.Downloader       : Extract /Users/nazar/.embedmongo/osx/mongodb-osx-ssl-x86_64-3.6.5.tgz : finished
2018-12-13 13:14:44.289  INFO 12277 --- [           main] c.j.s.embedmongo.EmbeddedMongoBuilder    : Starting embedded MongoDB instance
2018-12-13 13:14:45.467  INFO 12277 --- [           main] d.f.embed.mongo.MongodExecutable         : start de.flapdoodle.embed.mongo.config.MongodConfigBuilder$ImmutableMongodConfig@55fee662
2018-12-13 13:14:45.871  INFO 12277 --- [           main] org.mongodb.driver.cluster               : Cluster created with settings {hosts=[localhost:50770], mode=SINGLE, requiredClusterType=UNKNOWN, serverSelectionTimeout='30000 ms', maxWaitQueueSize=500}
2018-12-13 13:14:45.985  INFO 12277 --- [localhost:50770] org.mongodb.driver.connection            : Opened connection [connectionId{localValue:1, serverValue:1}] to localhost:50770
2018-12-13 13:14:45.990  INFO 12277 --- [localhost:50770] org.mongodb.driver.cluster               : Monitor thread successfully connected to server with description ServerDescription{address=localhost:50770, type=STANDALONE, state=CONNECTED, ok=true, version=ServerVersion{versionList=[3, 6, 5]}, minWireVersion=0, maxWireVersion=6, maxDocumentSize=16777216, logicalSessionTimeoutMinutes=30, roundTripTimeNanos=4065087}
2018-12-13 13:14:46.627  WARN 12277 --- [           main] c.t.p.p.configuration.BugsnagConfig      : Bugsnag apikey not set, not using it
2018-12-13 13:14:46.702  INFO 12277 --- [           main] c.t.p.p.c.AsyncConfigurationTest         : Creating sync task executor for tests
2018-12-13 13:15:38.019  INFO 12277 --- [       Thread-7] o.s.b.a.mongo.embedded.EmbeddedMongo     : note: noprealloc may hurt performance in many applications
2018-12-13 13:15:38.057  INFO 12277 --- [       Thread-7] o.s.b.a.mongo.embedded.EmbeddedMongo     : 2018-12-13T13:15:38.056+0200 I CONTROL  [initandlisten] MongoDB starting : pid=12460 port=50789 dbpath=/var/folders/95/6cdccp1s629gtfwm5tjb63gr0000gp/T/embedmongo-db-8535bf9e-fdc6-44f3-88c8-4bc77dd60bb3 64-bit host=sdos-MacBook-Pro.local
2018-12-13 13:15:38.057  INFO 12277 --- [       Thread-7] o.s.b.a.mongo.embedded.EmbeddedMongo     : 2018-12-13T13:15:38.057+0200 I CONTROL  [initandlisten] db version v3.5.5
2018-12-13 13:15:38.058  INFO 12277 --- [       Thread-7] o.s.b.a.mongo.embedded.EmbeddedMongo     : 2018-12-13T13:15:38.057+0200 I CONTROL  [initandlisten] git version: 98515c812b6fa893613f063dae568ff8319cbfbd
2018-12-13 13:15:38.058  INFO 12277 --- [       Thread-7] o.s.b.a.mongo.embedded.EmbeddedMongo     : 2018-12-13T13:15:38.057+0200 I CONTROL  [initandlisten] allocator: system
2018-12-13 13:15:38.058  INFO 12277 --- [       Thread-7] o.s.b.a.mongo.embedded.EmbeddedMongo     : 2018-12-13T13:15:38.057+0200 I CONTROL  [initandlisten] modules: none
2018-12-13 13:15:38.058  INFO 12277 --- [       Thread-7] o.s.b.a.mongo.embedded.EmbeddedMongo     : 2018-12-13T13:15:38.057+0200 I CONTROL  [initandlisten] build environment:
2018-12-13 13:15:38.058  INFO 12277 --- [       Thread-7] o.s.b.a.mongo.embedded.EmbeddedMongo     : 2018-12-13T13:15:38.057+0200 I CONTROL  [initandlisten]     distarch: x86_64
2018-12-13 13:15:38.058  INFO 12277 --- [       Thread-7] o.s.b.a.mongo.embedded.EmbeddedMongo     : 2018-12-13T13:15:38.057+0200 I CONTROL  [initandlisten]     target_arch: x86_64
2018-12-13 13:15:38.058  INFO 12277 --- [       Thread-7] o.s.b.a.mongo.embedded.EmbeddedMongo     : 2018-12-13T13:15:38.057+0200 I CONTROL  [initandlisten] options: { net: { bindIp: "127.0.0.1", http: { enabled: false }, port: 50789 }, security: { authorization: "disabled" }, storage: { dbPath: "/var/folders/95/6cdccp1s629gtfwm5tjb63gr0000gp/T/embedmongo-db-8535bf9e-fdc6-44f3-88c8-4bc77dd60bb3", journal: { enabled: false }, mmapv1: { preallocDataFiles: false, smallFiles: true }, syncPeriodSecs: 0.0 } }

这里是:完整的控制台日志

在以下行之后,它会卡住:

c.t.p.p.c.AsyncConfigurationTest: 为测试创建同步任务执行器

这是来自pom文件的片段:

<parent>
    <groupId>org.springframework.boot</groupId>
    <artifactId>spring-boot-starter-parent</artifactId>
    <version>2.1.0.RELEASE</version>
    <relativePath/> <!-- lookup parent from repository -->
</parent>
<dependencies>
    <dependency>
        <groupId>org.springframework.boot</groupId>
        <artifactId>spring-boot-starter-data-mongodb</artifactId>
    </dependency>
    <dependency>
        <groupId>de.flapdoodle.embed</groupId>
        <artifactId>de.flapdoodle.embed.mongo</artifactId>
        <version>2.1.1</version>
        <scope>test</scope>
    </dependency>
    <dependency>
        <groupId>cz.jirutka.spring</groupId>
        <artifactId>embedmongo-spring</artifactId>
        <version>1.3.1</version>
        <scope>test</scope>
    </dependency>
    <dependency>
        <groupId>org.springframework.boot</groupId>
        <artifactId>spring-boot-starter-test</artifactId>
        <scope>test</scope>
    </dependency>

不需要额外插件,只需使用spring-boot-maven-plugin

同时,在application.yml中也不需要为测试进行额外的配置。

下面是MongoDB的配置:

@Configuration
public class MongoConfig {

    private static final String MONGO_DB_URL = "localhost";
    private static final String MONGO_DB_NAME = "embeded_db";

    @Bean
    public MongoTemplate mongoTemplate() throws IOException {
        EmbeddedMongoFactoryBean mongo = new EmbeddedMongoFactoryBean();
        mongo.setBindIp(MONGO_DB_URL);
        MongoClient mongoClient = mongo.getObject();
        return new MongoTemplate(mongoClient, MONGO_DB_NAME);
    }
}

任务执行器配置:

@Slf4j
@Configuration
@Profile("test")
public class AsyncConfigurationTest {

    @Bean
    @Primary
    public TaskExecutor taskExecutor() {
        log.info("Creating sync task executor for tests");
        return new SyncTaskExecutor();
    }
}

测试看起来像这样:

@Slf4j
@SpringBootTest
@ActiveProfiles("test")
@RunWith(SpringRunner.class)
public class ServiceTest extends BaseDataServiceTest {

@Value("classpath:enter/enter_file.pdf")
private Resource enterPdf;
@Value("classpath:enter/expected.json")
private Resource enterExpectedJson;

@Test
public void testEnterDemoDocument() {
    testHelper(enterPdf, enterExpectedJson);
}

一切正常,但目前速度非常慢。
如何调查问题的瓶颈?

为什么启动这么慢?


你有两个嵌入式Mongo实例,为什么?移除embedmongo-spring,只留下flapdoodle的一个。删除你的MongoConfig,因为Spring Boot已经支持flapdoodle,然后再试一次。另外,你的BaseDataServiceTest是做什么的? - M. Deinum
@M.Deinum,出乎意料的是,它使测试执行速度快了很多,大约12秒。您能否更详细地解释一下它到底是做什么的? - catch23
实际上我不知道,但是根据 GitHub 仓库的记录,embedmongo-spring 库已经有大约 3 到 4 年没有更新了,而 flapdoodle 的库则在 4 天前进行了更新。此外,Spring Boot 已经内置了对此的支持,因此无需再包装其他内容。主要问题是删除您不需要的混乱并从那里开始。 - M. Deinum
2个回答

4
Spring Boot自带嵌入式MongoDB支持。此外,embedmongo-spring似乎已经过时,三年未更新。

不要尝试在嵌入式MongoDB周围包装其他内容,而是使用Spring Boot自带的嵌入式MongoDB支持。

注意:您也可以从flapdoodle依赖项中删除<version>,因为Spring Boot也对其进行了依赖管理。

<dependency>
    <groupId>org.springframework.boot</groupId>
    <artifactId>spring-boot-starter-data-mongodb</artifactId>
</dependency>
<dependency>
    <groupId>de.flapdoodle.embed</groupId>
    <artifactId>de.flapdoodle.embed.mongo</artifactId>
    <scope>test</scope>
</dependency>
<dependency>
    <groupId>org.springframework.boot</groupId>
    <artifactId>spring-boot-starter-test</artifactId>
    <scope>test</scope>
</dependency>

这些依赖应该是你所需要的全部。


0

我遇到了完全相同的问题,但我没有使用Spring Boot。我发现在我的情况下问题出在这一行代码上(嵌入式mongo使用了它):

        InetAddress ret = InetAddress.getLocalHost();

这是修复方法 InetAddress.getLocalHost() 运行缓慢(30+秒)


网页内容由stack overflow 提供, 点击上面的
可以查看英文原文,
原文链接