Modern storage trends – impact on the data centre
While the mantra ‘Go digital or die’ might seem a little bit harsh, there’s no doubt that many traditional businesses and, indeed, business sectors, are under increasing threat from their pure-play digital competitors. One of the major reasons for this is technology.
While many traditional businesses are busy trying to adapt to the modern, digital age, for most, if not all, it’s a question of hanging on to their existing, on-premise legacy infrastructure at the same time as embracing the possibilities of colocation, cloud and managed services. A not unreasonable approach one might argue. However, when compared to those digital companies who don’t have to sweat their data centre and IT assets, indeed, don’t have to own any such assets, then the playing field is far from level.
Business technology seems to be developing at a faster rate than ever previously witnessed and, at the very least, every organisation needs to understand what is now possible, whether or not they choose to take advantage of these possibilities.
When it comes to the data centre, depending on one’s perspective, the on-premise model is under threat from or, at the very least, needs to work alongside, colocation facilities, as well as the Cloud. A modern, so-called digital, data centre, is a prerequisite for any organisation claiming to be serious about digital transformation. That’s because such a facility needs to be able to house the very latest storage, networking and compute building blocks that underpin this era of massive change and disruption.
Talk of businesses being available 24x7x365 used to be something of an industry platitude. Everyone talked about it, but no one really believed that continuous availability was achievable and, even if it was, such availability came at too high a price. Now, no matter where, when or how they try to interact with your business, your customers expect to have a high quality, uninterrupted experience. Anything less, and they’ll be off to a competitor.
I’ll not get involved in the age-old argument as to which is the most important IT building block, but it’s safe to say that data storage and storage networks are a crucial part of providing the optimised customer experience – hidden away in a data centre though they may be. So, just what do you need to understand about modern storage technology as you (almost certainly) look to develop and optimised, customer-centric, hybrid data centre and IT infrastructure model?
The following is a list of what’s going on in the world of storage, and will hopefully help you to plan for the future:
1. Solid State Disks (SSDs) continue to replace Hard Disk Drives (HDDs), as there is an increasing amount of high-performance computing and big data workloads. For the data centre, this means there are potential power and cooling savings to be made, and a possible reduction in racks from those required for HDDs to the equivalent SSDs. The reality is that much higher density storage comes about – many more SSDs can fit into the rack(s) that previously housed HDDs. The end result? Almost certainly, more power and cooling is actually required in the data centre, with liquid cooling gaining much interest. Flash storage in the data centre is only going to become denser as it becomes cheaper to acquire
2. Hyperconverged systems (where storage and servers are combined in one unit) are becoming increasingly popular, as they are, theoretically at least, much easier to install, faster to deploy and much easier to maintain.
3. Hybrid storage environments look set to proliferate. That’s to say, a combination of on-premise, colocation and cloud and/or a managed service. This provides the flexibility to ensure that the right storage is deployed for the right task or application. Hence, decisions need to be made about what storage is required, where it should be placed and accessed.
4. Edge storage applications will increase significantly. The edge is not going to replace centralised or regionalised data centres, but add another option to the overall data centre ecosystem. Indeed, depending on the type of business, it’s possible that quite a complex, multi-layered data centre model will need to be developed. However, edge data centres look set to ‘explode’ and these will require fast, real-time storage components to ensure that the storage network is not a bottleneck when it comes to the Internet of Things (IoT) and many other edge applications.
5. The estimates vary, but all agree that there is going to be (or continue to be) a massive growth in data, and this all needs to be stored somewhere. So, data centre storage capacity will need to expand significantly over time. How to do this (in-house, colocation, cloud, managed service) is an important decision, best undertaken using the emerging AIOps tools, which provide detailed understanding and insight into data centre and IT infrastructure operations.
6. AI (as in AIOps mentioned above) will have an increasingly important role to play in terms of storage management. Human beings will no longer be able to make decisions fast enough when it comes to monitoring, measuring, analysing and improving/optimising complex IT infrastructure – including storage – and there will be an increasing reliance on AI tools to manage and optimise complex data centre/IT environments.
7. Non-Volatile-Memory-Express (NVMe) and Over Fabrics (NVME-oF) is an emerging storage protocol that promises to reduce latency in the data centre even further. In simple terms, NVME-oF allows the sharing of high performance, costly storage across many more servers, accelerating data transfers between server hosts and target storage.
8. Multi-cloud data management. Not dissimilar to point 3 above, this new breed of software is required to help users move, manage and use the data they have stored across multiple cloud (and on-premise/colo) environments.
9. Composable infrastructure. This appears to be a new name (and possibly a newer iteration) for software-defined infrastructure. Compute, storage and networks are abstracted from their physical locations and are managed by a software layer. The ultimate objective is to create a pool of IT resources which can be dynamically provisioned to create optimised infrastructure for any specific application.
10. Faster storage requires faster networks. A fairly obvious point, but one which is surprisingly often overlooked. There’s no point in upgrading your storage performance unless your networks are able to provide comparable feeds and speeds!
11. Storage Class Memory (SCM). A technology that is said to blur the lines between RAM and solid-state storage, SCM is a type of NAND flash that offers the promise of read/write technology which is up to ten times faster than NAND itself and is also more durable. We’re talking feeds and speeds again.
12. Helium-filled HDDs. Despite all the claims being made for flash storage, HDDs aren’t going to disappear any time soon. Helium-filled HDDs offer somewhere between 30-40% power savings when compared to traditional HDDs. This is because of the lower friction of the helium gas, which is lighter than the air found in HDDs. This same characteristic also offers the potential of higher speeds and storage densities.
13. Intelligent storage. There is a growing emphasis on managing data, rather than simply storage. This comes back to the idea that data centre and IT infrastructure does not exist in isolation but to serve customer and business-facing applications. The more one understands about where, when, how and why data is stored in a particular location, the easier it is to ensure that it in the optimal location at any given moment. For those who remember it, information lifecycle management (ILM) was a precursor of intelligent storage – lacking much of the technology which now provides the intelligence.
14. Blockchain storage. Primarily, blockchain be used to track the movement and storage of data within an organisation. However, there’s also some talk around the potential of blockchain storage networks – whereby companies with spare storage capacity can lease nodes to a blockchain-controlled storage service. In the same way that individuals are encouraged to lease out their homes and even cars to others, blockchain could be the catalyst for creating a new storage leasing market.
Industry: Data Centre / Data Center
- DevSecOpp- Security design / review consultant. SC Clearance. London
CH7838 London £70,000 DevSecOpp- Security design / review consultant. DevSecOpp- Security design / review consultant will ensure that newly created, public facing apps are secure by design and by default by aligning them to current / best practice security policies and standards into the design phases. The individual must have a technical software / application development background with specalist experinece in secure architecture design. (Frameworks, processes, best practice etc) Practical experience translating and ensuring that the OWASP top 10, ISO27001, HMG frameworks requirements are reviewed and embedded into project designs which are implemented is essential. Experience working projects through a full development lifecycle is key. You will work along side the design and project teams to idenitfy and mitigate risks throughout the design phases. This is a permanent role. SC clearance is essential as is the ability to get to the London office. (When appropiate #covid) Security DevSecOps consultant. To arrange a discreet call book via https://calendly.com/chris-holt/devsecopp--security-design-review-consultant
- SPLUNK SOC Analyst level 3, London.
SPLUNK SOC Analyst level 3, Must be able to commute to the City of London. Onsite role. Security clearance needed. The SPLUNK SOC Analyst level 3 must have current experience working within a SOC environment with specific experience using a range of tools and techniques to investigate security incidents. Current experience with Splunk is essential. any additional experience Individuals with Elastic Security SIEM are highly desirable. Any of the following certifications are desirable Splunk Phantom certified admin, Splunk Core Certified Power User / Advanced, Splunk Certified Enterprise Security Admin, etc The role will include, but not be limited to working with sophisticated information security tools, investigating security incidents, incident management, technical escalation, process improvement, research into the latest threats, reporting etc The individual MUST currently be living in the UK and be able to achieve UK security clearance. (SC) This is a permanent role To arrange a call with Chris Holt https://calendly.com/chris-holt/arranged-call-with-chris-holt-elastic-siem-engineer-soc Chris.Holt@dclsearch.com
- ISO 27001 & Business Continuity Security Specialist, End User
- United Kingdom
CH7828 ISO 27001 & Business Continuity Security Specialist, End User, £70,000 United Kingdom ISO 27001 & Business Continuity Security Specialist needed to join a Cyber team within an end user. The ISO 27001 & Business Continuity Security Specialist will have end to end responsibility for the information security and Business Continuity management system. ISMS/BCMS. Both from an information security and technical security perspective working alongside the CISO. Experience must include, but not be limited to; a mix of Information Security standards, frameworks, audit principles, controls / policies and the management and use of the technical tooling to achieve compliance. ISO 22301, ISO 27001, NIST Cybersecurity Framework etc An ideal candidate will be working within an end user environment with a cyber consultancy background. Experience taking a company through accreditation is highly desirable Experience managing internal stakeholders, technical teams and external third parties essential Flexible working, very occasional travel to London office This is an exclusive role to DCL Search & Selection. Looking to interview immediately. https://calendly.com/chris-holt/iso-27001-business-continuity-security-specialis
- PCI- DSS Security Consultant, End User
PCI- DSS Security Consultant needed to join a Cyber team within an end user. The PCI- DSS Security Consultant will have end to end responsibility for PCI - DSS and its continuing certification. Both from an information security and technical security perspective working alongside the CISO. Experience must include, but not be limited to; a mix of Information Security standards, frameworks, audit principles, controls / policies and the management and use of the technical tooling to achieve compliance. PCI objectives / 12 key requirements, OWASP top 10, ISO 27001, NIST Cybersecurity Framework etc An ideal candidate will be working within an end user environment with a cyber consultancy background. PCI Cloud compliance, specifically someone with experience taking PCI-DSS from on premise into the cloud is HIGHLY desired. However, someone with Solid PCI experience with a strong technical background which include Cyber / Secure by design etc would be considered. Experience managing internal stakeholders and external third parties essential. Flexible working, but with the ability to get into London. This is an exclusive role to DCL Search & Selection. 1st stage interviews to happen the week of the 14th September Arrange a call with Chris on https://calendly.com/chris-holt/arrange-a-call-chris-dcl-pci-compliance