如何为Elasticsearch自定义插件编写测试?

26

我创建了一个自定义的Elasticsearch插件。现在我想为这个插件编写一个测试。

我的期望是 - 我可以运行嵌入式的Elasticsearch实例,正确地设置它,然后进行一些测试(索引一些文档,然后查询它)

问题是我无法正确设置我的插件

自定义插件代码正在解析JSON查询并设置一些对象以供以后使用:

public class CustomQueryParserPlugin extends AbstractPlugin {
    public static final String PLUGIN_NAME = "custom_query";
    private final Settings settings;

    @Inject
    public CustomQueryParserPlugin (Settings settings) {
        this.settings = settings;
    }

    @Override
    public String name() {
        return PLUGIN_NAME;
    }

    @Override
    public String description() {
        return "custom plugin";
    }

    public void onModule(IndicesQueriesModule module) {
        module.addQuery(new CustomQueryParser(settings));
    }
}

测试代码:

public class CustomParserPluginTest extends ElasticsearchSingleNodeTest {

    private static Node newNode() {
        final Settings settings = ImmutableSettings.builder()
                .put(ClusterName.SETTING, nodeName())
                .put("node.name", nodeName())
                .put(IndexMetaData.SETTING_NUMBER_OF_SHARDS, 1)
                .put(IndexMetaData.SETTING_NUMBER_OF_REPLICAS, 0)
                .put(EsExecutors.PROCESSORS, 1) // limit the number of threads created
                .put("http.enabled", false)
                .put("plugin.types", CustomParserPlugin.class.getName())
                .put("path.plugins", pathToPlugin)
                .put("index.store.type", "ram")
                .put("config.ignore_system_properties", true) // make sure we get what we set :)
                .put("gateway.type", "none").build();
        Node build = NodeBuilder.nodeBuilder().local(true).data(true).settings(
                settings).build();
        build.start();
        assertThat(DiscoveryNode.localNode(build.settings()), is(true));
        return build;
    }


    @Test
    public void jsonParsing() throws URISyntaxException {
        final Client client = newNode().client();
        final SearchResponse test = client.prepareSearch("test-index").setSource(addQuery()).execute().actionGet();
    }

    private String addQuery() {
         return "{"match_all":{"boost":1.2}}"
    }

我尝试了多个值作为pathToPlugin,但似乎都不起作用,因为JSON查询总是给我一个异常:

QueryParsingException[[test-index] No query registered for [custom_query]];

我所能找到的所有文档都是关于安装插件并在本地Elasticsearch上进行测试的。

我做错了什么?是否有任何关于这样的测试的文档或示例?

更新。这里是提取的CustomQueryParserPlugin代码的存储库 - https://github.com/MysterionRise/es-custom-parser

在测试的初始化部分,也许需要在内存索引中创建实例?


1
请问您能否分享包含CustomQueryParserPlugin类以及该插件所需的目录树的整个文件? - Rob
@Rob,感谢您的关注,我已经创建了一个包含此示例中所有提取代码的存储库。我会立即更新问题。 - Mysterion
1个回答

6

要为您的插件编写测试,您可以使用Elasticsearch Cluster Runner。 有关参考,请查看MinHash Plugin如何编写测试。

更新:

我已更改CustomParserPluginTest类以使用Elasticsearch Cluster Runner:

import static org.codelibs.elasticsearch.runner.ElasticsearchClusterRunner.newConfigs;
import java.util.Map;
import junit.framework.TestCase;
import org.codelibs.elasticsearch.runner.ElasticsearchClusterRunner;
import org.elasticsearch.action.get.GetResponse;
import org.elasticsearch.action.index.IndexResponse;
import org.elasticsearch.client.Client;
import org.elasticsearch.common.bytes.BytesArray;
import org.elasticsearch.common.settings.ImmutableSettings;
import org.elasticsearch.common.settings.ImmutableSettings.Builder;
import org.elasticsearch.common.xcontent.XContentBuilder;
import org.elasticsearch.common.xcontent.XContentFactory;
import org.elasticsearch.index.get.GetField;
import org.junit.Assert;
import org.elasticsearch.action.search.SearchResponse;
import static org.hamcrest.core.Is.is;

public class CustomParserPluginTest extends TestCase {

    private ElasticsearchClusterRunner runner;

    @Override
    protected void setUp() throws Exception {
        // create runner instance
        runner = new ElasticsearchClusterRunner();
        // create ES nodes
        runner.onBuild(new ElasticsearchClusterRunner.Builder() {
            @Override
            public void build(final int number, final Builder settingsBuilder) {
            }
        }).build(newConfigs().ramIndexStore().numOfNode(1));

        // wait for yellow status
        runner.ensureYellow();
    }

    @Override
    protected void tearDown() throws Exception {
        // close runner
        runner.close();
        // delete all files
        runner.clean();
    }

    public void test_jsonParsing() throws Exception {
        final String index = "test_index";

        runner.createIndex(index, ImmutableSettings.builder().build());
        runner.ensureYellow(index);

        final SearchResponse test = runner.client().prepareSearch(index).setSource(addQuery()).execute().actionGet();
    }

    private String addQuery() {
        return "{\"match_all\":{\"boost\":1.2}}";
    }
}

我已经创建了一个名为es-plugin.properties的文件(插件根目录\src\main\resources),其内容如下,它将强制elasticsearch实例加载插件:
plugin=CustomQueryParserPlugin

当您运行此测试时,您将在输出中看到新创建的elasticsearch实例加载了插件。
[2015-04-29 19:22:10,783][INFO ][org.elasticsearch.node ] [Node 1] version[1.5 .0], pid[34360], build[5448160/2015-03-23T14:30:58Z] [2015-04-29 19:22:10,784][INFO ][org.elasticsearch.node ] [Node 1] initializing ... [2015-04-29 19:22:10,795][INFO ][org.elasticsearch.plugins] [Node 1] loaded [custom_query], sites [] [2015-04-29 19:22:13,342][INFO ][org.elasticsearch.node ] [Node 1] initialized
希望这能帮到您。

请注意,从2.1版本开始,Elasticsearch不再从类路径中加载插件。请参见此处的讨论:https://discuss.elastic.co/t/add-plugins-from-classpath-in-embedded-elasticsearch-client-node/36269/6要使其仍然加载您的插件,您需要提供一个plugin.types设置,其中包含插件的完全限定名称(如果有多个,请使用逗号分隔)。 - Dzmitry

网页内容由stack overflow 提供, 点击上面的
可以查看英文原文,
原文链接