MongoDB is a general-purpose, document-based, distributed database built for modern application developers and for the cloud era. At Zolostays, we have been using MongoDB extensively. Recently we migrated our MongoDB clusters to Atlas with zero downtime using Atlas’s live migration feature.
About the event
MongoDB.local is an event is organized by MongoDB to let developers know about best practices, new features and promote their services. This year they hosted this event in Bengaluru on 12th September 2019.
Who attended the event from Zolo:
- Abhay Kumar – Senior Full Stack Developer
- Kushagra Mangal – Software Developer | Full Stack
- Pradeep GP – Product Manager.
Here are some highlights of the MongoDB event:
- Deep Dive Sessions
- Atlas Workshop
Introduction of MongoDb 4.2
- Distributed Transactions – MongoDB documents have always been ACID. Then transactions at collection level were introduced with 4.0. But these were not applicable for sharded clusters. Now version 4.2 makes it even easier to address a complete range of use cases with multi-document ACID transactions distributed across sharded clusters. Essentially this brings mutability to shard key. For example, in a geolocation sharded collection, if a user is moved from one country to another, the user’s data can also be transferred to a different cluster just by changing the shard key.
- Client-Side Field-Level Encryption – Selective encryption of individual document fields, each secured with its own key transparently on the client. Now credit card numbers, passwords and other personal information of the users can be encrypted and stored easily. The best part is that the client-side drivers are responsible for encryption and decryption and there will be no code change.
- On-Demand Materialized Views – Materialized views would allow developers that use MongoDB to move data denormalization from the application layer to the database layer.
- Wildcard Indexes – Simply defining a filter to automatically index all matching fields, sub-documents, and arrays within your documents are now possible with wildcard indexes.
New Features in Atlas
- Atlas Full-Text Search (beta) – The most popular database used by developers for implementing search is ElasticSearch. ElasticSearch is built on top of Lucene which is an open-source search engine. Now Atlas brings Lucene integrated with MongoDB 4.2.
- Auto Scaling – Atlas now provides fully automated capacity management. When enabled, Atlas will track key resource utilization metrics in real-time and scale up or down using predictive modeling.
- Data Lake – MongoDB Atlas Data Lake allows you to quickly query data in any format on Amazon S3 using the MongoDB Query Language (MQL). Currently, Data Lake supports a wide variety of data formats like csv, tsv, and json. Costs $5 per TB of data scanned, with an additional charge of data transfer.
- MongoDB Charts – Mongo has made using the realtime dynamic charts from MongoDB data with extreme simplicity. Everything is based on the Drag and drop model which instantly generates realtime charts on the data. These charts can be embedded into various applications or web pages according to the requirement. But as this can be easily checked on Atlas. (Demo)
- Certifications – Now Atlas is PCI DSS Certified along with other certifications like GDFR, HIPAA, SOC, ISO, etc.,
- Terraform – Infrastructure as code deployment technology is a fast-moving field, but Terraform has stood out with the community as a popular and effective tool for infrastructure. MongoDB is creating a Terraform Provider for MongoDB Atlas with a roadmap that includes full Atlas support for DB Users, Projects, IP Whitelisting, Clusters, Cloud Provider Snapshots, Network Peering and Encryption at Rest.
- Hashicorp’s Vault – The management of keys and secrets involved in operating infrastructure and applications is also a pain point for many, especially as more orgs move to Cloud first. Hashicorp’s Vault is a Cloud-ready solution to that problem. The Vault Secrets Engine for MongoDB Atlas will allow you to control the lifecycle (lease, renew, revoke) of your MongoDB database users and programmatic API keys in MongoDB Atlas.
- MongoDB Realm – Realm is an open-source object database management system, initially for mobile (Android/iOS), also available for platforms such as Xamarin or React Native and others, including desktop applications. After getting acquired by MongoDB, new capabilities are added to the Realm.
Data types like Dicts, Sets and Any/Mixed are introduced.
Cascading deletes, Inheritance and transformational queries are part of Realm now.
- MongoDB Connector for Apache Kafka – Kafka is designed for boundless streams of data that sequentially write events into commit logs, allowing real-time data movement between your services. The official MongoDB Connector for Apache Kafka is developed and supported by MongoDB engineers and verified by Confluent. The connector, now released in Beta, enables MongoDB to be configured as both a sink and a source for Apache Kafka.
- MongoDB Enterprise Kubernetes Operator – DevOps teams are leveraging the power of containerization, and technologies like Kubernetes and Red Hat OpenShift, to manage containerized database clusters. Kubernetes Operator (beta) that integrates with Ops Manager, the enterprise management platform for MongoDB. The operator enables a user to deploy and manage MongoDB clusters from the Kubernetes API, without having to manually configure them in Ops Manager.
2. Deep-dive Sessions
- Tips and Tricks++ for Querying and Indexing MongoDB (link)
- New Encryption Capabilities in MongoDB 4.2: A Deep Dive into Protecting Sensitive Workloads (link)
- MongoDB Atlas Full-Text Search Deep Dive (link)
- Realm: The Secret Sauce for Better Mobile Apps (link)
- Distributed Transactions: With Great Power Comes Great Responsibility (link)
- Using MongoDB Services in Kubernetes: Any Platform, Development or Production (link)
- Put Your Data To Work (link)
- The Journey of Migration from Oracle to MongoDB at Rakuten (link)
- MongoDB Atlas Data Lake Technical Deep Dive (link)
- Lift & Shift MongoDB to Atlas (link)
3. Atlas Workshop
This time, Joe Drumgoole, Director of Developer Advocacy, EMEA at MongoDB took a workshop on Atlas. He emphasized the importance of the WiredTiger engine and MongoDB 4.2 features. There was a hands-on demo on the basics of Atlas as well.
Zolostays Tech@MongoDB.local Bengaluru 2019
- Explore MongoDB World 2019 announcements – https://www.mongodb.com/new
- Terraform and Vault are coming to MongoDB – https://www.mongodb.com/blog/post/terraform-and-vault-are-coming-to-mongodb-atlas
- MongoDB Atlas Compliance – https://www.mongodb.com/cloud/trust#compliance
- Realm – https://en.wikipedia.org/wiki/Realm_(database)
- MongoDB Kafka Connector – https://www.mongodb.com/kafka-connector
- MongoDB Kubernetes Operator – https://www.mongodb.com/blog/post/introducing-mongodb-enterprise-operator-for-kubernetes-openshift