[camel-kafka-connector] branch master updated (be2125e -> 4be9a2a)

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

[camel-kafka-connector] branch master updated (be2125e -> 4be9a2a)

acosentino
This is an automated email from the ASF dual-hosted git repository.

acosentino pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/camel-kafka-connector.git.


    from be2125e  Removed unused AWS common module that was moved to Camel Core
     new 6e0a04a  Github source connector: Add some transforms to deal with the different possible events
     new 4be9a2a  Regen docs for github connector

The 2 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 .../resources/connectors/camel-github-sink.json    |  5 ++++-
 .../resources/connectors/camel-github-source.json  |  5 ++++-
 .../src/generated/resources/camel-github-sink.json |  5 ++++-
 .../generated/resources/camel-github-source.json   |  5 ++++-
 .../docs/camel-github-kafka-sink-connector.adoc    |  9 ++++++++-
 .../docs/camel-github-kafka-source-connector.adoc  |  9 ++++++++-
 .../github/transformers/EventTypeTransforms.java}  | 22 +++++++++++-----------
 .../camel-github-kafka-sink-connector.adoc         |  9 ++++++++-
 .../camel-github-kafka-source-connector.adoc       |  9 ++++++++-
 9 files changed, 59 insertions(+), 19 deletions(-)
 copy connectors/{camel-sftp-kafka-connector/src/main/java/org/apache/camel/kafkaconnector/sftp/transformers/SftpRemoteFileTransforms.java => camel-github-kafka-connector/src/main/java/org/apache/camel/kafkaconnector/github/transformers/EventTypeTransforms.java} (70%)

Reply | Threaded
Open this post in threaded view
|

[camel-kafka-connector] 01/02: Github source connector: Add some transforms to deal with the different possible events

acosentino
This is an automated email from the ASF dual-hosted git repository.

acosentino pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/camel-kafka-connector.git

commit 6e0a04ac55d476dcc05b1b3bf5d887d9d9f04925
Author: Andrea Cosentino <[hidden email]>
AuthorDate: Wed Jan 13 13:35:54 2021 +0100

    Github source connector: Add some transforms to deal with the different possible events
---
 .../github/transformers/EventTypeTransforms.java   | 71 ++++++++++++++++++++++
 1 file changed, 71 insertions(+)

diff --git a/connectors/camel-github-kafka-connector/src/main/java/org/apache/camel/kafkaconnector/github/transformers/EventTypeTransforms.java b/connectors/camel-github-kafka-connector/src/main/java/org/apache/camel/kafkaconnector/github/transformers/EventTypeTransforms.java
new file mode 100644
index 0000000..7895935
--- /dev/null
+++ b/connectors/camel-github-kafka-connector/src/main/java/org/apache/camel/kafkaconnector/github/transformers/EventTypeTransforms.java
@@ -0,0 +1,71 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements.  See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License.  You may obtain a copy of the License at
+ *
+ *      http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+package org.apache.camel.kafkaconnector.github.transformers;
+
+import java.util.Map;
+
+import org.apache.camel.kafkaconnector.utils.SchemaHelper;
+import org.apache.kafka.common.config.ConfigDef;
+import org.apache.kafka.connect.connector.ConnectRecord;
+import org.apache.kafka.connect.transforms.Transformation;
+import org.eclipse.egit.github.core.event.Event;
+import org.slf4j.Logger;
+import org.slf4j.LoggerFactory;
+
+public class EventTypeTransforms <R extends ConnectRecord<R>> implements Transformation<R> {
+    public static final String FIELD_KEY_CONFIG = "key";
+    public static final ConfigDef CONFIG_DEF = new ConfigDef()
+            .define(FIELD_KEY_CONFIG, ConfigDef.Type.STRING, null, ConfigDef.Importance.MEDIUM,
+                    "Transforms an Event Type to String");
+
+    private static final Logger LOG = LoggerFactory.getLogger(EventTypeTransforms.class);
+
+    @Override
+    public R apply(R r) {
+        Object value = r.value();
+
+        if (value instanceof Event) {
+            LOG.debug("Converting record from Event Type to text");
+            Event message = (Event) r.value();
+
+            LOG.debug("Received text: {}", message.getType());
+
+            return r.newRecord(r.topic(), r.kafkaPartition(), null, r.key(),
+                    SchemaHelper.buildSchemaBuilderForType(message.getType()), message.getType(), r.timestamp());
+
+        } else {
+            LOG.debug("Unexpected message type: {}", r.value().getClass());
+
+            return r;
+        }
+    }
+
+    @Override
+    public ConfigDef config() {
+        return CONFIG_DEF;
+    }
+
+    @Override
+    public void close() {
+
+    }
+
+    @Override
+    public void configure(Map<String, ?> map) {
+
+    }
+}

Reply | Threaded
Open this post in threaded view
|

[camel-kafka-connector] 02/02: Regen docs for github connector

acosentino
In reply to this post by acosentino
This is an automated email from the ASF dual-hosted git repository.

acosentino pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/camel-kafka-connector.git

commit 4be9a2aca38b4577ece7188b5aacf069fd8b8aef
Author: Andrea Cosentino <[hidden email]>
AuthorDate: Wed Jan 13 13:59:47 2021 +0100

    Regen docs for github connector
---
 .../src/generated/resources/connectors/camel-github-sink.json    | 5 ++++-
 .../src/generated/resources/connectors/camel-github-source.json  | 5 ++++-
 .../src/generated/resources/camel-github-sink.json               | 5 ++++-
 .../src/generated/resources/camel-github-source.json             | 5 ++++-
 .../src/main/docs/camel-github-kafka-sink-connector.adoc         | 9 ++++++++-
 .../src/main/docs/camel-github-kafka-source-connector.adoc       | 9 ++++++++-
 .../ROOT/pages/connectors/camel-github-kafka-sink-connector.adoc | 9 ++++++++-
 .../pages/connectors/camel-github-kafka-source-connector.adoc    | 9 ++++++++-
 8 files changed, 48 insertions(+), 8 deletions(-)

diff --git a/camel-kafka-connector-catalog/src/generated/resources/connectors/camel-github-sink.json b/camel-kafka-connector-catalog/src/generated/resources/connectors/camel-github-sink.json
index 2670807..286beda 100644
--- a/camel-kafka-connector-catalog/src/generated/resources/connectors/camel-github-sink.json
+++ b/camel-kafka-connector-catalog/src/generated/resources/connectors/camel-github-sink.json
@@ -103,5 +103,8 @@
  "priority": "MEDIUM",
  "required": "false"
  }
- }
+ },
+ "transforms": [
+ "org.apache.camel.kafkaconnector.github.transformers.EventTypeTransforms"
+ ]
 }
\ No newline at end of file
diff --git a/camel-kafka-connector-catalog/src/generated/resources/connectors/camel-github-source.json b/camel-kafka-connector-catalog/src/generated/resources/connectors/camel-github-source.json
index 4dea792..eb0ab5a 100644
--- a/camel-kafka-connector-catalog/src/generated/resources/connectors/camel-github-source.json
+++ b/camel-kafka-connector-catalog/src/generated/resources/connectors/camel-github-source.json
@@ -231,5 +231,8 @@
  "priority": "MEDIUM",
  "required": "false"
  }
- }
+ },
+ "transforms": [
+ "org.apache.camel.kafkaconnector.github.transformers.EventTypeTransforms"
+ ]
 }
\ No newline at end of file
diff --git a/connectors/camel-github-kafka-connector/src/generated/resources/camel-github-sink.json b/connectors/camel-github-kafka-connector/src/generated/resources/camel-github-sink.json
index 2670807..286beda 100644
--- a/connectors/camel-github-kafka-connector/src/generated/resources/camel-github-sink.json
+++ b/connectors/camel-github-kafka-connector/src/generated/resources/camel-github-sink.json
@@ -103,5 +103,8 @@
  "priority": "MEDIUM",
  "required": "false"
  }
- }
+ },
+ "transforms": [
+ "org.apache.camel.kafkaconnector.github.transformers.EventTypeTransforms"
+ ]
 }
\ No newline at end of file
diff --git a/connectors/camel-github-kafka-connector/src/generated/resources/camel-github-source.json b/connectors/camel-github-kafka-connector/src/generated/resources/camel-github-source.json
index 4dea792..eb0ab5a 100644
--- a/connectors/camel-github-kafka-connector/src/generated/resources/camel-github-source.json
+++ b/connectors/camel-github-kafka-connector/src/generated/resources/camel-github-source.json
@@ -231,5 +231,8 @@
  "priority": "MEDIUM",
  "required": "false"
  }
- }
+ },
+ "transforms": [
+ "org.apache.camel.kafkaconnector.github.transformers.EventTypeTransforms"
+ ]
 }
\ No newline at end of file
diff --git a/connectors/camel-github-kafka-connector/src/main/docs/camel-github-kafka-sink-connector.adoc b/connectors/camel-github-kafka-connector/src/main/docs/camel-github-kafka-sink-connector.adoc
index 7a1ca4e..42e2dda 100644
--- a/connectors/camel-github-kafka-connector/src/main/docs/camel-github-kafka-sink-connector.adoc
+++ b/connectors/camel-github-kafka-connector/src/main/docs/camel-github-kafka-sink-connector.adoc
@@ -51,10 +51,17 @@ The camel-github sink connector has no converters out of the box.
 
 
 
-The camel-github sink connector has no transforms out of the box.
+The camel-github sink connector supports 0 transforms out of the box, which are listed below.
 
 
 
+[source,java]
+----
+
+org.apache.camel.kafkaconnector.github.transformers.EventTypeTransforms
+
+----
+
 
 
 The camel-github sink connector has no aggregation strategies out of the box.
diff --git a/connectors/camel-github-kafka-connector/src/main/docs/camel-github-kafka-source-connector.adoc b/connectors/camel-github-kafka-connector/src/main/docs/camel-github-kafka-source-connector.adoc
index fb9acb0..88a8baf 100644
--- a/connectors/camel-github-kafka-connector/src/main/docs/camel-github-kafka-source-connector.adoc
+++ b/connectors/camel-github-kafka-connector/src/main/docs/camel-github-kafka-source-connector.adoc
@@ -68,10 +68,17 @@ The camel-github source connector has no converters out of the box.
 
 
 
-The camel-github source connector has no transforms out of the box.
+The camel-github source connector supports 0 transforms out of the box, which are listed below.
 
 
 
+[source,java]
+----
+
+org.apache.camel.kafkaconnector.github.transformers.EventTypeTransforms
+
+----
+
 
 
 The camel-github source connector has no aggregation strategies out of the box.
diff --git a/docs/modules/ROOT/pages/connectors/camel-github-kafka-sink-connector.adoc b/docs/modules/ROOT/pages/connectors/camel-github-kafka-sink-connector.adoc
index 7a1ca4e..42e2dda 100644
--- a/docs/modules/ROOT/pages/connectors/camel-github-kafka-sink-connector.adoc
+++ b/docs/modules/ROOT/pages/connectors/camel-github-kafka-sink-connector.adoc
@@ -51,10 +51,17 @@ The camel-github sink connector has no converters out of the box.
 
 
 
-The camel-github sink connector has no transforms out of the box.
+The camel-github sink connector supports 0 transforms out of the box, which are listed below.
 
 
 
+[source,java]
+----
+
+org.apache.camel.kafkaconnector.github.transformers.EventTypeTransforms
+
+----
+
 
 
 The camel-github sink connector has no aggregation strategies out of the box.
diff --git a/docs/modules/ROOT/pages/connectors/camel-github-kafka-source-connector.adoc b/docs/modules/ROOT/pages/connectors/camel-github-kafka-source-connector.adoc
index fb9acb0..88a8baf 100644
--- a/docs/modules/ROOT/pages/connectors/camel-github-kafka-source-connector.adoc
+++ b/docs/modules/ROOT/pages/connectors/camel-github-kafka-source-connector.adoc
@@ -68,10 +68,17 @@ The camel-github source connector has no converters out of the box.
 
 
 
-The camel-github source connector has no transforms out of the box.
+The camel-github source connector supports 0 transforms out of the box, which are listed below.
 
 
 
+[source,java]
+----
+
+org.apache.camel.kafkaconnector.github.transformers.EventTypeTransforms
+
+----
+
 
 
 The camel-github source connector has no aggregation strategies out of the box.